-- Logs begin at Fri 2022-08-19 16:21:53 UTC, end at Fri 2022-08-19 17:58:32 UTC. -- Aug 19 17:25:47.955910 dv-osbrick-853777-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 17:25:47.967590 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 17:25:47.969747 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 17:25:47 2022] *** Aug 19 17:25:47.969747 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 17:25:47.969747 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 17:25:47.969747 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: nodename: dv-osbrick-853777-1-ceph Aug 19 17:25:47.969747 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: machine: x86_64 Aug 19 17:25:47.969747 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: clock source: unix Aug 19 17:25:47.969747 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: pcre jit disabled Aug 19 17:25:47.969747 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: detected number of CPU cores: 4 Aug 19 17:25:47.969747 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: current working directory: / Aug 19 17:25:47.969747 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: detected binary path: /usr/bin/uwsgi-core Aug 19 17:25:47.970420 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: your processes number limit is 47680 Aug 19 17:25:47.970420 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: your memory page size is 4096 bytes Aug 19 17:25:47.970420 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: detected max file descriptor number: 2048 Aug 19 17:25:47.970420 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: lock engine: pthread robust mutexes Aug 19 17:25:47.970420 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: thunder lock: enabled Aug 19 17:25:47.970420 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 17:25:47.970420 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 17:25:48.014114 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: Python main interpreter initialized at 0x5628f744f9c0 Aug 19 17:25:48.014114 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: python threads support enabled Aug 19 17:25:48.014114 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: your server socket listen backlog is limited to 100 connections Aug 19 17:25:48.014114 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: your mercy for graceful operations on workers is 90 seconds Aug 19 17:25:48.014419 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 17:25:48.014499 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: *** Operational MODE: preforking *** Aug 19 17:25:48.014750 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: *** uWSGI is running in multiple interpreter mode *** Aug 19 17:25:48.014750 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: spawned uWSGI master process (pid: 88623) Aug 19 17:25:48.014927 dv-osbrick-853777-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 19 17:25:48.017561 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: spawned uWSGI worker 1 (pid: 88636, cores: 1) Aug 19 17:25:48.017561 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: spawned uWSGI worker 2 (pid: 88637, cores: 1) Aug 19 17:25:48.017561 dv-osbrick-853777-1-ceph devstack@keystone.service[88623]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 17:25:52.672762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 17:25:52.672762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: from cryptography.utils import int_from_bytes Aug 19 17:25:52.673578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 17:25:52.673578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: from cryptography.utils import int_from_bytes Aug 19 17:25:52.678172 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 17:25:52.678172 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: from cryptography.utils import int_from_bytes Aug 19 17:25:52.679857 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 17:25:52.679857 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: from cryptography.utils import int_from_bytes Aug 19 17:25:52.727797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 17:25:52.727990 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 17:25:52.728163 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] command line args: [] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 17:25:52.729006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 17:25:52.729186 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ================================================================================ {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 17:25:52.729441 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] admin_token = **** {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.729528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 17:25:52.729684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] config_dir = [] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.729772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 17:25:52.729875 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.729963 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] command line args: [] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 17:25:52.730041 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] config_source = [] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.730146 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 17:25:52.730236 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] debug = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.730315 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ================================================================================ {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 17:25:52.730392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.730695 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] admin_token = **** {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.730803 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.730913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] config_dir = [] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.731019 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.731117 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.731117 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] config_source = [] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.731323 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.731427 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] debug = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.731545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.731644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.731765 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] list_limit = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.731868 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.731981 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] log_config_append = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.732087 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.732191 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.732288 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.732396 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] log_dir = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.732396 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] log_file = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.732579 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.732700 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.732827 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] list_limit = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.732827 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] log_config_append = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.733021 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.733104 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.733182 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.733307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] log_dir = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.733383 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.733510 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] log_file = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.733591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.733591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.733730 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.733807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.733878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.734037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.734128 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.734269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.734362 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.734484 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.734606 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.734716 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.734813 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.734938 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.735025 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.735098 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.735216 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.735324 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.735404 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.735561 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.735698 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.735780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.736007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.736151 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.736286 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.736376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] publish_errors = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.736482 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.736565 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.736762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.736928 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.737011 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.737175 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.737370 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.737459 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.737570 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] publish_errors = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.737646 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] standard_threads = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.737789 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.737890 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.738024 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.738111 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.738216 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.738293 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.738389 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] use_journal = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.738462 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.738575 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] use_json = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.738652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.738712 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] use_stderr = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.738944 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] use_syslog = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.739034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] standard_threads = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.739104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.739176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.739346 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.739434 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.739544 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.739627 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.739694 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] use_journal = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.739834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.739903 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] use_json = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.740041 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] use_stderr = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.740125 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.740187 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] use_syslog = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.740277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.740447 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:25:52.740596 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.740715 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.740862 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.740978 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.741093 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.741227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.741351 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.741468 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.741584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.741706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.741822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.741946 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.742069 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.742195 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.742318 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.742434 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.742556 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.742689 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.742806 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.742921 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.743041 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.743158 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.743333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.743458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.743685 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.743787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.743889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.743988 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.744652 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.744793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.749667 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.749789 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.749889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.749963 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.750049 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.750124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.750202 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.750279 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.750351 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.750475 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.750626 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.750702 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.750780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.750780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.750908 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.750984 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751063 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751136 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751206 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751276 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751346 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751496 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751569 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751639 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751861 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.751940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.752013 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.752143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.752221 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.752291 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.752368 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.752448 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.752560 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.752639 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.752710 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.752839 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.752914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.752992 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.753065 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.753141 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.753218 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.753218 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.753431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.753520 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.753594 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.753665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.753735 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.753810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.753893 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.753966 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754112 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754183 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754331 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754424 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754520 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754602 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754676 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754737 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754878 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.754957 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755105 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755185 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755258 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755329 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755408 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755481 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755553 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755624 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755700 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755924 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.755994 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.756065 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.756141 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.756221 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.756295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.756374 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.756447 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.756518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.756593 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.756666 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.756784 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.756866 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.756945 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.757018 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.757157 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.757235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.757315 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.757388 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.757459 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.757539 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.757621 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.757699 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.757779 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.757858 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.757931 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.758002 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.758073 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.758149 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.758301 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.758382 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.758461 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.758534 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.758604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.758675 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.758753 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.758827 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.758947 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759024 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759103 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759176 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759260 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759345 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759501 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759501 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759766 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759766 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.759978 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.760061 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.760140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.760213 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.760293 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.760367 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.760438 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.760508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.760585 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.760657 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.760814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.760894 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.760966 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.761038 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.761038 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.761165 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.761244 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.761323 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.761395 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.761466 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.761538 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.761614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.761754 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.761859 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.761988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.762101 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.762231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.762341 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.762464 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.762579 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.762717 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.762799 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.762973 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.763053 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.763210 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.763298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.763437 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] auth.external = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.763519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.763663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.763743 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.763920 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.764001 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.764158 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.764244 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.764385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] auth.password = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.764465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.764614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] auth.token = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.764695 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.764874 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.764962 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.765110 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.765202 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.765376 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.765456 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.765611 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] auth.external = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.765741 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.765846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.766076 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.766167 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.766452 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.766554 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.766636 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.766717 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] credential.caching = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.766792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] auth.password = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.766872 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.766974 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] auth.token = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.767070 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.767222 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.767335 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.767456 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.767542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.767704 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.767800 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.767937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.768020 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.768184 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.768266 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.768431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.768515 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.768663 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.768762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.768924 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] credential.caching = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.769039 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.769176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.769267 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.769421 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.769504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.769668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.769750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.769906 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.769989 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.770151 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.770242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.770386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] federation.caching = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.770466 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.770616 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.770694 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.770852 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.770935 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.771096 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.771326 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.771456 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.771570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.771653 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.771804 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.771886 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.772056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.772140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.772290 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.772372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.772547 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.772671 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.778364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.778449 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] federation.caching = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.778626 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.778712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.778787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.caching = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.778861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.778950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779110 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779184 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779258 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779331 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779562 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779635 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779781 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779863 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.779944 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.780019 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.780098 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.780172 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.780245 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.780330 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.780405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.caching = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.780478 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.780478 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.780656 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.780761 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.780852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.780929 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781001 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781001 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781132 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781204 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781288 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781364 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781514 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781588 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781742 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781815 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.781958 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782183 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782183 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782313 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782589 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782781 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782855 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782916 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.782975 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783117 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783262 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783340 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783413 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783494 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783568 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783641 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783713 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783785 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783862 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.783944 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784018 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784162 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784234 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784306 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784389 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784536 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784608 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784862 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.784939 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785012 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785157 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785230 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785311 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785311 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785456 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785530 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785603 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785676 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785800 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785883 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.785957 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786174 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786258 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786407 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786479 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786551 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786790 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786864 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.786937 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787009 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787169 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787244 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787386 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787386 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787511 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787511 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787624 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787698 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787770 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787831 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787902 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.787973 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788053 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788200 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788272 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788349 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788502 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788658 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788823 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788890 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.788975 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789051 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789202 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789202 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789407 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789481 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789554 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789626 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789704 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789777 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789858 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.789932 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.790082 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.790165 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.790326 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.790407 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.790560 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.790643 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.790811 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.791387 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.791530 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.791622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.791773 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.791855 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.792008 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.792089 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.792239 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.792332 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.792474 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.792555 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.792712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.792828 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.792970 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.793127 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.793206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.793278 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.793421 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.793502 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.793910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] resource.caching = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.794006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.794157 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.794315 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.794424 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.794524 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.794623 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.794731 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.794941 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.795064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.795166 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.795266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.795366 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.795476 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.795577 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.795676 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.795776 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.795875 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.795996 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.796115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.796216 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] role.caching = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.796314 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.796458 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] role.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.796566 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.796686 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.796835 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.796947 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.797047 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] resource.caching = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.797186 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.797296 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.797432 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.797557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.797657 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.797754 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.797903 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.798017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.798145 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.798267 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.798380 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.798463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.798609 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.798691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.798835 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.798924 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.799072 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.799162 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.799307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] role.caching = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.799390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.799548 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.799638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] role.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.799775 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.799855 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.800021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.800179 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.800362 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.800459 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.800544 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.800647 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.800792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.800916 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.801034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.801161 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.801283 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.801406 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.801567 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.801654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.801819 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.801903 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.802052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.802134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.802297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.802379 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.802581 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.802673 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.802770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.802850 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.802998 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.803080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.803246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.803406 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.803488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.803644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.803725 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.803893 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.803984 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.804142 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.804223 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.804386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.804467 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.804620 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] token.caching = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.804710 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.804876 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.804959 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.805121 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.805203 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.805355 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.807227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.807227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.807414 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.807489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.807563 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.807636 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.807719 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.807782 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.807855 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.807927 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.807999 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.807999 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.808126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.808200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.808272 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.808345 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.808417 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.808490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.808570 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.808644 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.808710 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.808844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.808919 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] token.caching = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.808991 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.809076 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.809152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.809225 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.809297 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.809369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.809478 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.connection = **** {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.809571 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.809646 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.809892 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.809987 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.810124 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.810208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.810362 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.810456 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.810597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.810680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.810832 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.810915 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.811066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.811160 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.811300 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.811382 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.811534 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.811615 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.811766 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.811856 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.812007 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.812089 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.812234 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.812318 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.812473 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.812562 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.812705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.812808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.812973 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.813055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.connection = **** {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.813202 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.813362 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.813449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.813525 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.813658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.813747 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.813823 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 17:25:52.813952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.814187 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.814424 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.814659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.814895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.815138 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.815372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.815615 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.815849 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.816095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.816330 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.816572 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.816877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.817201 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.817439 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:25:52.817610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88636) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 17:25:52.842940 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.843235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.843327 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.846114 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.846346 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.846569 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.851799 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.855721 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.885872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.886098 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.886183 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.886379 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.943735 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.944047 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.998693 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:52.998918 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.000384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.000624 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.069193 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.069422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.069651 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.069737 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.069870 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.069956 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.070085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.070171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.070297 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.070382 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.070512 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.070730 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.093604 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.093830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.093923 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.094050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.094151 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.094269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.094354 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.094483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.094567 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.094697 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.094782 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.094908 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.095072 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.095290 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.106447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.106810 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.118893 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.119149 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.119235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.119369 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.119467 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.119587 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.119671 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.119797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.119880 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.120006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.120091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.120220 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.120344 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.120431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88636) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:25:53.144419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.144626 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 17:25:53.144746 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.144878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 17:25:53.144988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.145188 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 17:25:53.145285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.145403 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 17:25:53.145485 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.145674 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.145757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.145934 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.146025 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.146190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.146273 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.146443 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.156166 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.156443 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.156568 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.156712 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.156868 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.157017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.157135 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.157412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.163961 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.164405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.167451 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.167729 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.167981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.168068 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.168278 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.168363 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.168556 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.168919 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.169091 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.169176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.169357 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.169442 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.169623 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.169719 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.169886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.169970 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.170155 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.170237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.170419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.170502 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.170684 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.170947 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.193988 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.194514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.195382 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.195663 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.195960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.196243 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.200241 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.200524 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.200842 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.201130 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.201522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.202440 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.207944 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.208238 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.209028 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.209310 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.212197 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.212485 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.213308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.213708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.213793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.214020 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.214173 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.214321 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.214455 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.214595 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.214849 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.214933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.215126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.215402 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.215672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.215941 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.231936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.232224 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.232370 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.232650 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.236084 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.237096 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.239208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.239614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.243392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.243907 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.244569 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.247554 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.251176 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.251475 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.254192 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.254282 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.254282 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.254282 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.254282 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.254901 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.258110 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.258419 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.258708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.259099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.259384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.259726 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.268978 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.269267 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.269539 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.269808 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.276581 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.278382 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.278659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.281814 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.282099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.282380 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.282665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.282939 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.283563 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.283850 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.284117 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.284378 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.291251 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.293007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.293281 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.294480 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.294758 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.298825 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.298825 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.298825 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.298825 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.298825 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.299196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.299196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.299196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.299196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.299196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.309313 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.309595 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.309875 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.310163 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.310480 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.310772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.311044 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.311913 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.314902 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.317921 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.319349 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.320907 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.321191 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.321471 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.327167 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.328519 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.330030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.330129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.332948 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.333146 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.333233 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.333513 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.334517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.334649 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.336168 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.336455 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.336820 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.342690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.342979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.343262 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.343581 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.345049 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.347938 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.348333 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.348630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.348925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.350120 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.350507 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.350797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.351077 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.351349 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.351619 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.351907 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.352173 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.352439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.352712 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.353010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.353269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.358428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.358428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.358605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.358605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.358605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.365185 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88636) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:25:53.366587 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.366873 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.367159 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.367444 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.367716 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.367989 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.368257 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.368544 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.368850 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.369704 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.369966 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.370237 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.370494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88636) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:25:53.388104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5628f744f9c0 pid: 88637 (default app) Aug 19 17:25:53.391579 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf1a27-a9c1-403a-80cf-3322091d2f5c None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:25:53.398070 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf1a27-a9c1-403a-80cf-3322091d2f5c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:25:53.398070 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf1a27-a9c1-403a-80cf-3322091d2f5c None None] PATH_INFO: `/v3` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:25:53.398070 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Fri Aug 19 17:25:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:25:53.404115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5628f744f9c0 pid: 88636 (default app) Aug 19 17:26:01.556159 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fb072-3a1e-499f-ab09-d8f2e2dd3ffa None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:01.556764 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fb072-3a1e-499f-ab09-d8f2e2dd3ffa None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:01.556860 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fb072-3a1e-499f-ab09-d8f2e2dd3ffa None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:01.558133 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:01.565968 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862788d7-2710-4416-8b8a-5278b465df38 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:01.569126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862788d7-2710-4416-8b8a-5278b465df38 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:01.569126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862788d7-2710-4416-8b8a-5278b465df38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:01.644154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: INFO dbcounter [None req-862788d7-2710-4416-8b8a-5278b465df38 None None] Registered counter for database keystone Aug 19 17:26:01.665820 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG oslo_db.sqlalchemy.engines [None req-862788d7-2710-4416-8b8a-5278b465df38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88636) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 17:26:01.672782 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writer thread running {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 17:26:01.856389 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG passlib.handlers.bcrypt [None req-862788d7-2710-4416-8b8a-5278b465df38 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88636) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 17:26:01.856832 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG passlib.handlers.bcrypt [None req-862788d7-2710-4416-8b8a-5278b465df38 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88636) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 17:26:01.911799 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-862788d7-2710-4416-8b8a-5278b465df38 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:01.913492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-862788d7-2710-4416-8b8a-5278b465df38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:02.041928 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 1/3] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 17:26:02.526692 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fb072-3a1e-499f-ab09-d8f2e2dd3ffa None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:02.601146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: INFO dbcounter [None req-694fb072-3a1e-499f-ab09-d8f2e2dd3ffa None None] Registered counter for database keystone Aug 19 17:26:02.620793 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG oslo_db.sqlalchemy.engines [None req-694fb072-3a1e-499f-ab09-d8f2e2dd3ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 17:26:02.627057 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writer thread running {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 17:26:02.743728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fb072-3a1e-499f-ab09-d8f2e2dd3ffa None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:02.747966 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54382d-5410-4cf3-b777-414b0c00aafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:02.748579 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54382d-5410-4cf3-b777-414b0c00aafd admin admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:02.748889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54382d-5410-4cf3-b777-414b0c00aafd admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:02.749162 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54382d-5410-4cf3-b777-414b0c00aafd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:02.757185 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54382d-5410-4cf3-b777-414b0c00aafd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:02.809021 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2e54382d-5410-4cf3-b777-414b0c00aafd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 17:26:02.809364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54382d-5410-4cf3-b777-414b0c00aafd admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:02.818864 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 3/4] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Aug 19 17:26:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 17:26:02.824891 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862788d7-2710-4416-8b8a-5278b465df38 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:02.842373 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862788d7-2710-4416-8b8a-5278b465df38 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:02.846773 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77045d82-b8c4-4ab9-82da-b2bcd69ad253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:02.847855 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77045d82-b8c4-4ab9-82da-b2bcd69ad253 admin admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:02.848141 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77045d82-b8c4-4ab9-82da-b2bcd69ad253 admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:02.848419 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77045d82-b8c4-4ab9-82da-b2bcd69ad253 admin admin] PATH_INFO: `/v3/projects/72d7a88be3624749bd4e592197eaa598` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:02.849935 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77045d82-b8c4-4ab9-82da-b2bcd69ad253 admin admin] RBAC: Authorizing `identity:get_project(project_id=72d7a88be3624749bd4e592197eaa598)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:02.900882 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: WARNING keystone.common.rbac_enforcer.enforcer [None req-77045d82-b8c4-4ab9-82da-b2bcd69ad253 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 17:26:02.901230 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77045d82-b8c4-4ab9-82da-b2bcd69ad253 admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:02.905780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 2/5] 10.222.0.27 () {56 vars in 1207 bytes} [Fri Aug 19 17:26:02 2022] GET /identity/v3/projects/72d7a88be3624749bd4e592197eaa598 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:05.049867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de8dbd-4bd4-4411-91e3-fd40002ea31a None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:05.050413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de8dbd-4bd4-4411-91e3-fd40002ea31a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:05.050413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de8dbd-4bd4-4411-91e3-fd40002ea31a None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:05.054505 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 4/6] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:26:05.060449 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e489df2-5653-4b5f-b67f-41aae73cfc3a None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:05.060860 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e489df2-5653-4b5f-b67f-41aae73cfc3a None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:05.061029 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e489df2-5653-4b5f-b67f-41aae73cfc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:05.081069 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-5e489df2-5653-4b5f-b67f-41aae73cfc3a None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:05.082572 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-5e489df2-5653-4b5f-b67f-41aae73cfc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:05.090277 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 3/7] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 17:26:05.415416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de8dbd-4bd4-4411-91e3-fd40002ea31a None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:05.427777 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de8dbd-4bd4-4411-91e3-fd40002ea31a None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:05.431962 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53fb7d-7d9b-4bfb-84f3-13c46f208ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:05.432550 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53fb7d-7d9b-4bfb-84f3-13c46f208ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:05.432867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53fb7d-7d9b-4bfb-84f3-13c46f208ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:05.433139 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53fb7d-7d9b-4bfb-84f3-13c46f208ad3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:05.440600 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53fb7d-7d9b-4bfb-84f3-13c46f208ad3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:05.442401 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53fb7d-7d9b-4bfb-84f3-13c46f208ad3 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:05.451432 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 5/8] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Aug 19 17:26:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 17:26:05.456836 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e489df2-5653-4b5f-b67f-41aae73cfc3a None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:05.466480 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e489df2-5653-4b5f-b67f-41aae73cfc3a None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:05.470875 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e45340-e292-4f44-8eec-45aa478123c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:05.471491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e45340-e292-4f44-8eec-45aa478123c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:05.471772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e45340-e292-4f44-8eec-45aa478123c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:05.472082 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e45340-e292-4f44-8eec-45aa478123c9 admin admin] PATH_INFO: `/v3/users/4194ee18e96548d99ebb8f12d43b6b6f` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:05.473412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e45340-e292-4f44-8eec-45aa478123c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=4194ee18e96548d99ebb8f12d43b6b6f)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:05.475230 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e45340-e292-4f44-8eec-45aa478123c9 admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:05.476733 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 4/9] 10.222.0.27 () {56 vars in 1198 bytes} [Fri Aug 19 17:26:05 2022] GET /identity/v3/users/4194ee18e96548d99ebb8f12d43b6b6f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:07.718394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d9cf0-65c6-49f4-8d57-383c64d5dc5d None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:07.718898 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d9cf0-65c6-49f4-8d57-383c64d5dc5d None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:07.718898 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d9cf0-65c6-49f4-8d57-383c64d5dc5d None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:07.720279 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:07.725492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f13f9-8c9a-4168-ac5a-d75f4c491cf0 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:07.725891 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f13f9-8c9a-4168-ac5a-d75f4c491cf0 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:07.726121 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f13f9-8c9a-4168-ac5a-d75f4c491cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:07.743666 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-722f13f9-8c9a-4168-ac5a-d75f4c491cf0 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:07.744930 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-722f13f9-8c9a-4168-ac5a-d75f4c491cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:07.763536 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7c9d-a97b-426e-943e-4d66db776663 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:07.763813 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7c9d-a97b-426e-943e-4d66db776663 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:07.764078 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7c9d-a97b-426e-943e-4d66db776663 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:07.765410 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 7/11] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:26:07.770257 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04525304-d710-4873-a32c-4daba60df03c None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:07.770534 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04525304-d710-4873-a32c-4daba60df03c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:07.770804 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04525304-d710-4873-a32c-4daba60df03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:07.813110 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG passlib.handlers.bcrypt [None req-04525304-d710-4873-a32c-4daba60df03c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88637) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 17:26:07.813532 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG passlib.handlers.bcrypt [None req-04525304-d710-4873-a32c-4daba60df03c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88637) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 17:26:07.827108 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 5/12] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:07.859363 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-04525304-d710-4873-a32c-4daba60df03c None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:07.860992 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-04525304-d710-4873-a32c-4daba60df03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:07.959065 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 8/13] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:08.149536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f13f9-8c9a-4168-ac5a-d75f4c491cf0 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:08.173018 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:08.285576 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04525304-d710-4873-a32c-4daba60df03c None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:08.361165 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f13f9-8c9a-4168-ac5a-d75f4c491cf0 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:08.386084 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04525304-d710-4873-a32c-4daba60df03c None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:08.388312 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:08.394459 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c939b-7e0b-4e2d-9f09-d442fbd35031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:08.395155 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c939b-7e0b-4e2d-9f09-d442fbd35031 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:08.395519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c939b-7e0b-4e2d-9f09-d442fbd35031 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:08.395793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c939b-7e0b-4e2d-9f09-d442fbd35031 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:08.407006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c939b-7e0b-4e2d-9f09-d442fbd35031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-893c939b-7e0b-4e2d-9f09-d442fbd35031 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:08.416871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:08.419630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:08.420655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 6/14] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:26:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:08.424968 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c939b-7e0b-4e2d-9f09-d442fbd35031 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:08.427388 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc1a03-201d-4fc6-ad8a-54efad9dbb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:08.428263 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc1a03-201d-4fc6-ad8a-54efad9dbb76 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:08.428548 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc1a03-201d-4fc6-ad8a-54efad9dbb76 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:08.428849 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc1a03-201d-4fc6-ad8a-54efad9dbb76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:08.496237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc1a03-201d-4fc6-ad8a-54efad9dbb76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:08.497795 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc1a03-201d-4fc6-ad8a-54efad9dbb76 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:08.507762 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:08.525923 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c939b-7e0b-4e2d-9f09-d442fbd35031 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:08.560315 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0024e0-c045-482c-b0e9-982113568e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:08.560937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0024e0-c045-482c-b0e9-982113568e0e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:08.561222 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0024e0-c045-482c-b0e9-982113568e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:08.561485 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0024e0-c045-482c-b0e9-982113568e0e None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:08.562135 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0024e0-c045-482c-b0e9-982113568e0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:08.562431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0024e0-c045-482c-b0e9-982113568e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:08.563789 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0024e0-c045-482c-b0e9-982113568e0e None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:08.575317 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 7/15] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:08.580747 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0024e0-c045-482c-b0e9-982113568e0e None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:08.594170 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 9/16] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 17:26:08.599562 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc1a03-201d-4fc6-ad8a-54efad9dbb76 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:08.612867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:08.679197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0024e0-c045-482c-b0e9-982113568e0e None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:08.698397 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc1a03-201d-4fc6-ad8a-54efad9dbb76 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:08.712806 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ef012-3f94-4afb-b729-1e57f282a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:08.713430 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ef012-3f94-4afb-b729-1e57f282a0bc None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:08.713707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ef012-3f94-4afb-b729-1e57f282a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:08.713978 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ef012-3f94-4afb-b729-1e57f282a0bc None admin] PATH_INFO: `/v3/users/4194ee18e96548d99ebb8f12d43b6b6f` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:08.715097 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ef012-3f94-4afb-b729-1e57f282a0bc None admin] RBAC: Authorizing `identity:get_user(user_id=4194ee18e96548d99ebb8f12d43b6b6f)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:08.716541 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ef012-3f94-4afb-b729-1e57f282a0bc None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:08.718123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 8/17] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:08 2022] GET /identity/v3/users/4194ee18e96548d99ebb8f12d43b6b6f => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:08.723366 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ef012-3f94-4afb-b729-1e57f282a0bc None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:08.731837 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bc9ba-a21d-4785-8b63-fdff2837cb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:08.732689 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bc9ba-a21d-4785-8b63-fdff2837cb02 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:08.733005 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bc9ba-a21d-4785-8b63-fdff2837cb02 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:08.733278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bc9ba-a21d-4785-8b63-fdff2837cb02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:08.738195 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:08.753902 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bc9ba-a21d-4785-8b63-fdff2837cb02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:08.755398 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bc9ba-a21d-4785-8b63-fdff2837cb02 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-9f3bc9ba-a21d-4785-8b63-fdff2837cb02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:26:08.772518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:08.774552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:26:08.775887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:26:08.775887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:26:08.775887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:08.775887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:26:08.827070 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ef012-3f94-4afb-b729-1e57f282a0bc None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:08.864123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10550f3-f2d5-4cf3-b8cd-a85257c25d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:08.864811 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10550f3-f2d5-4cf3-b8cd-a85257c25d32 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:08.865095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10550f3-f2d5-4cf3-b8cd-a85257c25d32 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:08.865368 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10550f3-f2d5-4cf3-b8cd-a85257c25d32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:08.866550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10550f3-f2d5-4cf3-b8cd-a85257c25d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:08.868031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10550f3-f2d5-4cf3-b8cd-a85257c25d32 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:08.870184 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:08.876019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10550f3-f2d5-4cf3-b8cd-a85257c25d32 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:08.888851 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bc9ba-a21d-4785-8b63-fdff2837cb02 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:08.943531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:08.957317 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:08.975166 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10550f3-f2d5-4cf3-b8cd-a85257c25d32 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:08.987000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bc9ba-a21d-4785-8b63-fdff2837cb02 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:09.008755 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b4d9c-2627-4dde-9b34-f8e1e5f0e94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:09.009366 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b4d9c-2627-4dde-9b34-f8e1e5f0e94a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:09.010202 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b4d9c-2627-4dde-9b34-f8e1e5f0e94a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:09.010478 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b4d9c-2627-4dde-9b34-f8e1e5f0e94a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:09.011192 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b4d9c-2627-4dde-9b34-f8e1e5f0e94a None admin] RBAC: Adding query filter params (role.id=17791940429e48ac98d4bd49aa53a88c, scope.domain.id=default, user.id=4194ee18e96548d99ebb8f12d43b6b6f) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:09.011496 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b4d9c-2627-4dde-9b34-f8e1e5f0e94a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:09.012959 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b4d9c-2627-4dde-9b34-f8e1e5f0e94a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:09.019662 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Aug 19 17:26:08 2022] GET /identity/v3/role_assignments?user.id=4194ee18e96548d99ebb8f12d43b6b6f&scope.domain.id=default&role.id=17791940429e48ac98d4bd49aa53a88c => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:09.020151 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5d141-aceb-48d6-a9a7-7b2a6905391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:09.020861 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5d141-aceb-48d6-a9a7-7b2a6905391b None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:09.021162 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5d141-aceb-48d6-a9a7-7b2a6905391b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:09.021413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5d141-aceb-48d6-a9a7-7b2a6905391b None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:09.022048 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5d141-aceb-48d6-a9a7-7b2a6905391b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:09.022349 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5d141-aceb-48d6-a9a7-7b2a6905391b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:09.023750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5d141-aceb-48d6-a9a7-7b2a6905391b None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:09.043479 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:11.427074 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6865-ee3d-4961-a217-b2ec4a49f91f None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:11.427525 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6865-ee3d-4961-a217-b2ec4a49f91f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:11.427709 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6865-ee3d-4961-a217-b2ec4a49f91f None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:11.429294 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:11.434402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d69b34-8065-4f5a-9fc9-ee3492cba85d None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:11.435215 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d69b34-8065-4f5a-9fc9-ee3492cba85d None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:11.435696 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d69b34-8065-4f5a-9fc9-ee3492cba85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:11.465709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-65d69b34-8065-4f5a-9fc9-ee3492cba85d None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:11.467229 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-65d69b34-8065-4f5a-9fc9-ee3492cba85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:11.550958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 12/23] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:11.770824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e43506-22d1-4ba9-acfa-5c02287427ae None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:11.771484 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e43506-22d1-4ba9-acfa-5c02287427ae None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:11.771979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e43506-22d1-4ba9-acfa-5c02287427ae None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:11.773829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:11.779641 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a95d10-b43e-400e-9f3f-12161957c232 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:11.779928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a95d10-b43e-400e-9f3f-12161957c232 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:11.780205 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a95d10-b43e-400e-9f3f-12161957c232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:11.802884 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-c4a95d10-b43e-400e-9f3f-12161957c232 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:11.804057 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-c4a95d10-b43e-400e-9f3f-12161957c232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:11.824222 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c11a5-c402-4125-b3d8-4daa1ae04740 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:11.824900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c11a5-c402-4125-b3d8-4daa1ae04740 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:11.825242 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c11a5-c402-4125-b3d8-4daa1ae04740 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:11.827073 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 13/25] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:11.832035 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539e392-6963-48dd-941d-258b899a2f48 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:11.832577 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539e392-6963-48dd-941d-258b899a2f48 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:11.833077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539e392-6963-48dd-941d-258b899a2f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:11.862855 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:11.869738 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-5539e392-6963-48dd-941d-258b899a2f48 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:11.870960 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-5539e392-6963-48dd-941d-258b899a2f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:11.898727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 13/26] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:11.970914 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 14/27] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:12.165944 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a95d10-b43e-400e-9f3f-12161957c232 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:12.223958 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068206a-328a-4892-9c2b-d578eabacab4 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:12.224463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068206a-328a-4892-9c2b-d578eabacab4 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:12.224900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068206a-328a-4892-9c2b-d578eabacab4 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:12.226386 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 15/28] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:26:12.231957 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaae74-072c-4d87-a656-35362b27d178 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:12.232418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaae74-072c-4d87-a656-35362b27d178 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:12.232916 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaae74-072c-4d87-a656-35362b27d178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:12.268134 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-9deaae74-072c-4d87-a656-35362b27d178 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:12.269615 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-9deaae74-072c-4d87-a656-35362b27d178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:12.282831 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a95d10-b43e-400e-9f3f-12161957c232 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:12.365425 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c2d28-c666-4b36-93ee-660cf87b6af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:12.366071 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c2d28-c666-4b36-93ee-660cf87b6af3 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:12.366347 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c2d28-c666-4b36-93ee-660cf87b6af3 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:12.366623 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c2d28-c666-4b36-93ee-660cf87b6af3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:12.386210 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 16/29] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:12.386548 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c2d28-c666-4b36-93ee-660cf87b6af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-6d0c2d28-c666-4b36-93ee-660cf87b6af3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:12.392987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:12.393821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:12.394574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 14/30] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:26:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:12.399918 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaae74-072c-4d87-a656-35362b27d178 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:12.408084 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c2d28-c666-4b36-93ee-660cf87b6af3 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:12.414433 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:12.482260 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:12.601722 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaae74-072c-4d87-a656-35362b27d178 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:12.604261 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c2d28-c666-4b36-93ee-660cf87b6af3 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:12.664288 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc212237-a09f-4f16-b6f0-be2c71627e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:12.665587 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc212237-a09f-4f16-b6f0-be2c71627e39 None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:12.666766 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc212237-a09f-4f16-b6f0-be2c71627e39 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:12.667713 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04230dd2-179f-4de9-a10f-24e92a7e89de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:12.668297 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc212237-a09f-4f16-b6f0-be2c71627e39 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:12.669444 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04230dd2-179f-4de9-a10f-24e92a7e89de None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:12.670473 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc212237-a09f-4f16-b6f0-be2c71627e39 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:12.672126 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc212237-a09f-4f16-b6f0-be2c71627e39 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:12.672602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04230dd2-179f-4de9-a10f-24e92a7e89de None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:12.673095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04230dd2-179f-4de9-a10f-24e92a7e89de None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:12.673957 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04230dd2-179f-4de9-a10f-24e92a7e89de None admin] RBAC: Adding query filter params (name=admin) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:12.674465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04230dd2-179f-4de9-a10f-24e92a7e89de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:12.679627 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04230dd2-179f-4de9-a10f-24e92a7e89de None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:12.693540 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 17/31] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:12.694697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04230dd2-179f-4de9-a10f-24e92a7e89de None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:12.765312 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:12.808425 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04230dd2-179f-4de9-a10f-24e92a7e89de None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:12.839382 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30fb36-dec5-4161-9bf1-001df0b3a2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:12.840017 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30fb36-dec5-4161-9bf1-001df0b3a2f2 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:12.840298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30fb36-dec5-4161-9bf1-001df0b3a2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:12.840575 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30fb36-dec5-4161-9bf1-001df0b3a2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:12.851701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30fb36-dec5-4161-9bf1-001df0b3a2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:12.853791 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30fb36-dec5-4161-9bf1-001df0b3a2f2 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-5a30fb36-dec5-4161-9bf1-001df0b3a2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:26:12.870054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:12.870949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:26:12.871755 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:26:12.871755 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:26:12.871755 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:12.871755 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 18/32] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:12.871968 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30fb36-dec5-4161-9bf1-001df0b3a2f2 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:12.927518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 15/33] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 19 17:26:12 2022] POST /identity/v3/roles => generated 219 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:26:12.928935 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc212237-a09f-4f16-b6f0-be2c71627e39 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:13.067485 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30fb36-dec5-4161-9bf1-001df0b3a2f2 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:13.091701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:13.109169 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:13.118052 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc212237-a09f-4f16-b6f0-be2c71627e39 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:13.121949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fee952-f53e-4419-850d-41a33a3bebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:13.122880 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fee952-f53e-4419-850d-41a33a3bebb8 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:13.123382 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fee952-f53e-4419-850d-41a33a3bebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:13.123899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fee952-f53e-4419-850d-41a33a3bebb8 None admin] PATH_INFO: `/v3/users/4194ee18e96548d99ebb8f12d43b6b6f` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:13.127286 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fee952-f53e-4419-850d-41a33a3bebb8 None admin] RBAC: Authorizing `identity:get_user(user_id=4194ee18e96548d99ebb8f12d43b6b6f)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:13.129180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fee952-f53e-4419-850d-41a33a3bebb8 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:13.134527 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 19/34] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:12 2022] GET /identity/v3/users/4194ee18e96548d99ebb8f12d43b6b6f => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:13.135592 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fee952-f53e-4419-850d-41a33a3bebb8 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:13.174713 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4d358-04bf-476b-8178-748479d32ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:13.175509 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4d358-04bf-476b-8178-748479d32ebb None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:13.175803 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4d358-04bf-476b-8178-748479d32ebb None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:13.176079 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4d358-04bf-476b-8178-748479d32ebb None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:13.176809 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4d358-04bf-476b-8178-748479d32ebb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:13.178547 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4d358-04bf-476b-8178-748479d32ebb None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:13.264770 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fee952-f53e-4419-850d-41a33a3bebb8 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:13.303226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5048d6-7aef-4114-a06f-368fbfdd312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:13.303993 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 16/35] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 19 17:26:12 2022] POST /identity/v3/roles => generated 225 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:26:13.304335 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5048d6-7aef-4114-a06f-368fbfdd312a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:13.304830 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5048d6-7aef-4114-a06f-368fbfdd312a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:13.305291 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5048d6-7aef-4114-a06f-368fbfdd312a None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:13.306163 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5048d6-7aef-4114-a06f-368fbfdd312a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:13.306862 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5048d6-7aef-4114-a06f-368fbfdd312a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:13.308484 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5048d6-7aef-4114-a06f-368fbfdd312a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:13.313426 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4d358-04bf-476b-8178-748479d32ebb None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:13.350824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 20/36] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:13.357261 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5048d6-7aef-4114-a06f-368fbfdd312a None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:13.436106 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:13.490646 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4d358-04bf-476b-8178-748479d32ebb None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:13.498797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5048d6-7aef-4114-a06f-368fbfdd312a None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:13.532942 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b5a75-f0e7-4670-9656-733f6acc382e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:13.533990 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b5a75-f0e7-4670-9656-733f6acc382e None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:13.534473 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b5a75-f0e7-4670-9656-733f6acc382e None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:13.534975 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b5a75-f0e7-4670-9656-733f6acc382e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:13.539135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b5a75-f0e7-4670-9656-733f6acc382e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:13.539658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b5a75-f0e7-4670-9656-733f6acc382e None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:13.542131 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270935e2-c9ac-4a7a-bf69-d612cadd7573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:13.542256 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 17/37] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:13.544517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270935e2-c9ac-4a7a-bf69-d612cadd7573 None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:13.544517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270935e2-c9ac-4a7a-bf69-d612cadd7573 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:13.544517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270935e2-c9ac-4a7a-bf69-d612cadd7573 None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:13.544517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270935e2-c9ac-4a7a-bf69-d612cadd7573 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:13.544842 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17969d-ccb2-4191-a5a9-9f4e24b49dab None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:13.544910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17969d-ccb2-4191-a5a9-9f4e24b49dab None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:13.547393 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17969d-ccb2-4191-a5a9-9f4e24b49dab None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:13.547521 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270935e2-c9ac-4a7a-bf69-d612cadd7573 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:13.547609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 18/38] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:13.551216 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17969d-ccb2-4191-a5a9-9f4e24b49dab None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:13.582335 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:13.665824 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17969d-ccb2-4191-a5a9-9f4e24b49dab None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:13.699219 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25249448-ace9-4a1e-9a50-fdfe815b574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:13.699913 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25249448-ace9-4a1e-9a50-fdfe815b574b None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:13.700191 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25249448-ace9-4a1e-9a50-fdfe815b574b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:13.700474 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25249448-ace9-4a1e-9a50-fdfe815b574b None admin] PATH_INFO: `/v3/domains/default/users/4194ee18e96548d99ebb8f12d43b6b6f/roles/17791940429e48ac98d4bd49aa53a88c` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:13.702741 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25249448-ace9-4a1e-9a50-fdfe815b574b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4194ee18e96548d99ebb8f12d43b6b6f, role_id=17791940429e48ac98d4bd49aa53a88c)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:13.704296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25249448-ace9-4a1e-9a50-fdfe815b574b None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:13.812078 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 19/39] 10.222.0.27 () {58 vars in 1361 bytes} [Fri Aug 19 17:26:13 2022] PUT /identity/v3/domains/default/users/4194ee18e96548d99ebb8f12d43b6b6f/roles/17791940429e48ac98d4bd49aa53a88c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:26:13.830519 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bb98a-e482-4293-b2eb-8cbc63a990e0 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:13.830818 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bb98a-e482-4293-b2eb-8cbc63a990e0 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:13.831085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bb98a-e482-4293-b2eb-8cbc63a990e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:13.837467 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 19 17:26:13 2022] POST /identity/v3/projects => generated 301 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:26:13.839426 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce026215-6145-4fc5-9f16-b10710c4fa67 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:13.839724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce026215-6145-4fc5-9f16-b10710c4fa67 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:13.840005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce026215-6145-4fc5-9f16-b10710c4fa67 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:13.841690 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 22/41] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:13.850735 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c0740-0596-4a31-8c98-193ae25252e8 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:13.851047 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c0740-0596-4a31-8c98-193ae25252e8 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:13.851302 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c0740-0596-4a31-8c98-193ae25252e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:13.872208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-324c0740-0596-4a31-8c98-193ae25252e8 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:13.873901 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-324c0740-0596-4a31-8c98-193ae25252e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:13.881994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-077bb98a-e482-4293-b2eb-8cbc63a990e0 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:13.883627 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-077bb98a-e482-4293-b2eb-8cbc63a990e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:13.972792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 23/42] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:13.993424 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 20/43] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:14.302022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c0740-0596-4a31-8c98-193ae25252e8 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:14.324709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bb98a-e482-4293-b2eb-8cbc63a990e0 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:14.333421 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:14.341268 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:14.413676 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c0740-0596-4a31-8c98-193ae25252e8 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:14.430980 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bb98a-e482-4293-b2eb-8cbc63a990e0 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:14.458035 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c14236-0aef-4871-a4c4-901d55fd0140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:14.458668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c14236-0aef-4871-a4c4-901d55fd0140 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:14.458954 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c14236-0aef-4871-a4c4-901d55fd0140 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:14.459232 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c14236-0aef-4871-a4c4-901d55fd0140 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:14.460340 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c14236-0aef-4871-a4c4-901d55fd0140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:14.462196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c14236-0aef-4871-a4c4-901d55fd0140 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:14.464861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 24/44] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:14.469582 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c14236-0aef-4871-a4c4-901d55fd0140 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:14.470243 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2aed52-e66c-4adb-b13f-840b73195c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:14.470885 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aed52-e66c-4adb-b13f-840b73195c99 None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:14.471184 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aed52-e66c-4adb-b13f-840b73195c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:14.471465 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aed52-e66c-4adb-b13f-840b73195c99 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:14.472131 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2aed52-e66c-4adb-b13f-840b73195c99 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:14.473696 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2aed52-e66c-4adb-b13f-840b73195c99 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:14.564119 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:14.570205 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c14236-0aef-4871-a4c4-901d55fd0140 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:14.579401 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 21/45] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 19 17:26:14 2022] POST /identity/v3/roles => generated 223 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:26:14.608574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cdb77-e7e8-4564-9e0a-88697686418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:14.609261 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cdb77-e7e8-4564-9e0a-88697686418a None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:14.609596 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cdb77-e7e8-4564-9e0a-88697686418a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:14.609881 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cdb77-e7e8-4564-9e0a-88697686418a None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:14.610626 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cdb77-e7e8-4564-9e0a-88697686418a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:14.612224 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cdb77-e7e8-4564-9e0a-88697686418a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:14.698336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 25/46] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 19 17:26:14 2022] POST /identity/v3/projects => generated 312 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:26:16.021747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128413-65af-466c-8fe1-d6a3cf19b374 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:16.022263 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128413-65af-466c-8fe1-d6a3cf19b374 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:16.022347 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128413-65af-466c-8fe1-d6a3cf19b374 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:16.023594 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 22/47] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:16.028714 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a5d7d-df0e-4afe-ad2c-bf59196741f2 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:16.029126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a5d7d-df0e-4afe-ad2c-bf59196741f2 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:16.029299 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a5d7d-df0e-4afe-ad2c-bf59196741f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:16.047549 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-937a5d7d-df0e-4afe-ad2c-bf59196741f2 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:16.048715 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-937a5d7d-df0e-4afe-ad2c-bf59196741f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:16.112993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 26/48] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:16.434816 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128413-65af-466c-8fe1-d6a3cf19b374 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:16.510607 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:16.535987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128413-65af-466c-8fe1-d6a3cf19b374 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:16.580748 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839cde6-bce7-472b-80b4-c0896e41beb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:16.581415 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839cde6-bce7-472b-80b4-c0896e41beb0 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:16.581698 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839cde6-bce7-472b-80b4-c0896e41beb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:16.581976 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839cde6-bce7-472b-80b4-c0896e41beb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:16.593324 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839cde6-bce7-472b-80b4-c0896e41beb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-3839cde6-bce7-472b-80b4-c0896e41beb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:16.599775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:16.600868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:16.601598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 23/49] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:26:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:16.608862 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a5d7d-df0e-4afe-ad2c-bf59196741f2 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:16.684587 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:16.705814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a5d7d-df0e-4afe-ad2c-bf59196741f2 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:16.740783 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e79c65-221c-42ce-9580-bdb745ad1dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:16.741476 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e79c65-221c-42ce-9580-bdb745ad1dba None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:16.741754 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e79c65-221c-42ce-9580-bdb745ad1dba None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:16.742047 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e79c65-221c-42ce-9580-bdb745ad1dba None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:16.742727 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e79c65-221c-42ce-9580-bdb745ad1dba None admin] RBAC: Adding query filter params (name=admin) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:16.743030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e79c65-221c-42ce-9580-bdb745ad1dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:16.745005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e79c65-221c-42ce-9580-bdb745ad1dba None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:16.755246 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 27/50] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:16.761494 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839cde6-bce7-472b-80b4-c0896e41beb0 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:16.860202 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839cde6-bce7-472b-80b4-c0896e41beb0 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:16.895641 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1106aea-c262-4168-a776-c2fa5782811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:16.896273 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1106aea-c262-4168-a776-c2fa5782811a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:16.896552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1106aea-c262-4168-a776-c2fa5782811a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:16.896863 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1106aea-c262-4168-a776-c2fa5782811a None admin] PATH_INFO: `/v3/users/4194ee18e96548d99ebb8f12d43b6b6f` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:16.897980 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1106aea-c262-4168-a776-c2fa5782811a None admin] RBAC: Authorizing `identity:get_user(user_id=4194ee18e96548d99ebb8f12d43b6b6f)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:16.899424 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1106aea-c262-4168-a776-c2fa5782811a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:16.901591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 24/51] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:16 2022] GET /identity/v3/users/4194ee18e96548d99ebb8f12d43b6b6f => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:16.906315 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4a01-e98e-4d10-a5ec-dcd0ed810b49 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:16.906635 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4a01-e98e-4d10-a5ec-dcd0ed810b49 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:16.906740 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1106aea-c262-4168-a776-c2fa5782811a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:16.906917 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4a01-e98e-4d10-a5ec-dcd0ed810b49 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:16.908237 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 28/52] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:16.909439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:16.913165 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49353b24-3638-4117-9659-9c2d59e919ae None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:16.913454 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49353b24-3638-4117-9659-9c2d59e919ae None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:16.913734 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49353b24-3638-4117-9659-9c2d59e919ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:16.931323 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-49353b24-3638-4117-9659-9c2d59e919ae None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:16.932556 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-49353b24-3638-4117-9659-9c2d59e919ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:16.999407 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 29/53] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:17.004379 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1106aea-c262-4168-a776-c2fa5782811a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:17.036287 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efafa8a-be6c-4fd7-a267-5bfd3f80e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:17.036918 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efafa8a-be6c-4fd7-a267-5bfd3f80e365 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:17.037199 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efafa8a-be6c-4fd7-a267-5bfd3f80e365 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:17.037473 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efafa8a-be6c-4fd7-a267-5bfd3f80e365 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:17.038568 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efafa8a-be6c-4fd7-a267-5bfd3f80e365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:17.039984 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efafa8a-be6c-4fd7-a267-5bfd3f80e365 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:17.041559 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 25/54] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:17.047511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49353b24-3638-4117-9659-9c2d59e919ae None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:17.114781 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:17.145195 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49353b24-3638-4117-9659-9c2d59e919ae None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:17.177974 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5b2de-7537-469f-a521-4680e3899a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:17.178570 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5b2de-7537-469f-a521-4680e3899a1f None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:17.178847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5b2de-7537-469f-a521-4680e3899a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:17.179117 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5b2de-7537-469f-a521-4680e3899a1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:17.179829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5b2de-7537-469f-a521-4680e3899a1f None admin] RBAC: Adding query filter params (role.id=17791940429e48ac98d4bd49aa53a88c, scope.domain.id=default, user.id=4194ee18e96548d99ebb8f12d43b6b6f) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:17.180131 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5b2de-7537-469f-a521-4680e3899a1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:17.182126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5b2de-7537-469f-a521-4680e3899a1f None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:17.187699 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 30/55] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Aug 19 17:26:17 2022] GET /identity/v3/role_assignments?user.id=4194ee18e96548d99ebb8f12d43b6b6f&scope.domain.id=default&role.id=17791940429e48ac98d4bd49aa53a88c => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:17.327728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efafa8a-be6c-4fd7-a267-5bfd3f80e365 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:17.398287 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:17.435810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efafa8a-be6c-4fd7-a267-5bfd3f80e365 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:17.468019 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590969be-2a72-41fa-b90d-46c4f3525ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:17.468639 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590969be-2a72-41fa-b90d-46c4f3525ce4 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:17.468947 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590969be-2a72-41fa-b90d-46c4f3525ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:17.469217 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590969be-2a72-41fa-b90d-46c4f3525ce4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:17.470307 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590969be-2a72-41fa-b90d-46c4f3525ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:17.471742 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590969be-2a72-41fa-b90d-46c4f3525ce4 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:17.473298 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 26/56] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:17.479428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5b2de-7537-469f-a521-4680e3899a1f None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:17.577716 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5b2de-7537-469f-a521-4680e3899a1f None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:17.611247 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193aefc-160f-497f-b375-7f85476df91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:17.611815 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193aefc-160f-497f-b375-7f85476df91b None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:17.612094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193aefc-160f-497f-b375-7f85476df91b None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:17.612367 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193aefc-160f-497f-b375-7f85476df91b None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:17.613035 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193aefc-160f-497f-b375-7f85476df91b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:17.614466 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193aefc-160f-497f-b375-7f85476df91b None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:17.619630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:17.733955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 31/57] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Aug 19 17:26:17 2022] POST /identity/v3/projects => generated 298 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:26:19.885463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbc9be-438d-4d6e-9a11-eb2635976a73 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:19.885963 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbc9be-438d-4d6e-9a11-eb2635976a73 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:19.885963 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbc9be-438d-4d6e-9a11-eb2635976a73 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:19.887297 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 27/58] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:19.892951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f53ff-73ed-48f1-ac06-89bb65fc93fe None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:19.893331 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f53ff-73ed-48f1-ac06-89bb65fc93fe None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:19.893495 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f53ff-73ed-48f1-ac06-89bb65fc93fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:19.910773 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-d73f53ff-73ed-48f1-ac06-89bb65fc93fe None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:19.911935 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-d73f53ff-73ed-48f1-ac06-89bb65fc93fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:19.981245 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 32/59] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:20.307433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbc9be-438d-4d6e-9a11-eb2635976a73 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:20.406245 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbc9be-438d-4d6e-9a11-eb2635976a73 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:20.441817 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf7ec3-6dcb-40e6-bb34-67ec71ab9dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:20.442435 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf7ec3-6dcb-40e6-bb34-67ec71ab9dbe None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:20.442711 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf7ec3-6dcb-40e6-bb34-67ec71ab9dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:20.442981 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf7ec3-6dcb-40e6-bb34-67ec71ab9dbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:20.444056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf7ec3-6dcb-40e6-bb34-67ec71ab9dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:20.445541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf7ec3-6dcb-40e6-bb34-67ec71ab9dbe None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:20.447707 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 28/60] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:20.453413 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f53ff-73ed-48f1-ac06-89bb65fc93fe None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:20.548223 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f53ff-73ed-48f1-ac06-89bb65fc93fe None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:20.563670 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:20.580825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24410dc2-63d1-4e29-a8a7-47807408b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:20.581418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24410dc2-63d1-4e29-a8a7-47807408b3f2 None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:20.581694 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24410dc2-63d1-4e29-a8a7-47807408b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:20.581962 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24410dc2-63d1-4e29-a8a7-47807408b3f2 None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:20.582591 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24410dc2-63d1-4e29-a8a7-47807408b3f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:20.584133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24410dc2-63d1-4e29-a8a7-47807408b3f2 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:20.681454 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 33/61] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 19 17:26:20 2022] POST /identity/v3/users => generated 275 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:26:24.150894 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2ae9f-7f49-42d8-b0a0-f20f7b82afa6 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:24.151933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2ae9f-7f49-42d8-b0a0-f20f7b82afa6 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:24.152421 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2ae9f-7f49-42d8-b0a0-f20f7b82afa6 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:24.153969 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 29/62] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:24.159351 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64151fb3-b7cc-4146-9fb2-69e90a1c8ea9 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:24.160157 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64151fb3-b7cc-4146-9fb2-69e90a1c8ea9 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:24.160649 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64151fb3-b7cc-4146-9fb2-69e90a1c8ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:24.189800 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-64151fb3-b7cc-4146-9fb2-69e90a1c8ea9 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:24.191334 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-64151fb3-b7cc-4146-9fb2-69e90a1c8ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:24.226786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba03523-9646-427c-ade7-e3ac26fcad19 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:24.227391 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba03523-9646-427c-ade7-e3ac26fcad19 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:24.227887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba03523-9646-427c-ade7-e3ac26fcad19 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:24.230027 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 30/63] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:24.235022 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7008349-a73e-4303-a266-44aff169d921 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:24.235576 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7008349-a73e-4303-a266-44aff169d921 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:24.236054 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7008349-a73e-4303-a266-44aff169d921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:24.257222 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:24.265388 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-d7008349-a73e-4303-a266-44aff169d921 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:24.266585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-d7008349-a73e-4303-a266-44aff169d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:24.285204 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 34/64] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:24.286890 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e754013-7405-40fb-b239-3a27e358a720 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:24.287461 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e754013-7405-40fb-b239-3a27e358a720 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:24.287974 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e754013-7405-40fb-b239-3a27e358a720 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:24.289917 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 35/65] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:24.296651 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9b418-696e-4f88-bbf6-598e583efb56 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:24.297319 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9b418-696e-4f88-bbf6-598e583efb56 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:24.297797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9b418-696e-4f88-bbf6-598e583efb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:24.320885 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-7ba9b418-696e-4f88-bbf6-598e583efb56 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:24.322575 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-7ba9b418-696e-4f88-bbf6-598e583efb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:24.401263 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 36/66] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:24.418019 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 31/67] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:24.448599 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c63fdf-9322-41c7-aa76-3f4ad62a0dae None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:24.449152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c63fdf-9322-41c7-aa76-3f4ad62a0dae None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:24.449586 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c63fdf-9322-41c7-aa76-3f4ad62a0dae None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:24.451075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 37/68] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:24.456286 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d4eb-bec6-496e-9864-8f51a56f517a None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:24.456762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d4eb-bec6-496e-9864-8f51a56f517a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:24.457198 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d4eb-bec6-496e-9864-8f51a56f517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:24.475755 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-ae03d4eb-bec6-496e-9864-8f51a56f517a None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:24.477251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-ae03d4eb-bec6-496e-9864-8f51a56f517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:24.579082 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 32/69] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:24.689077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c63fdf-9322-41c7-aa76-3f4ad62a0dae None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:24.726237 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:24.788756 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d4eb-bec6-496e-9864-8f51a56f517a None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:24.818027 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c63fdf-9322-41c7-aa76-3f4ad62a0dae None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:24.857404 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd79a5-5571-439c-b3d8-293fc66f9311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:24.858031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd79a5-5571-439c-b3d8-293fc66f9311 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:24.858314 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd79a5-5571-439c-b3d8-293fc66f9311 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:24.858587 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd79a5-5571-439c-b3d8-293fc66f9311 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:24.872326 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd79a5-5571-439c-b3d8-293fc66f9311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-82bd79a5-5571-439c-b3d8-293fc66f9311 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:24.878422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:24.879274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:24.880025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 38/70] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:24.881143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c3307-fb78-4efe-9e08-220c25d7854a None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:24.881431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c3307-fb78-4efe-9e08-220c25d7854a None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:24.881708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c3307-fb78-4efe-9e08-220c25d7854a None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:24.883840 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 39/71] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:24.888502 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:24.889558 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c3307-fb78-4efe-9e08-220c25d7854a None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:24.917526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d4eb-bec6-496e-9864-8f51a56f517a None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:24.959029 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60d929-abfb-4380-8425-3123644435b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:24.959825 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60d929-abfb-4380-8425-3123644435b4 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:24.960510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60d929-abfb-4380-8425-3123644435b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:24.961038 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60d929-abfb-4380-8425-3123644435b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:24.974429 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60d929-abfb-4380-8425-3123644435b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-3d60d929-abfb-4380-8425-3123644435b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:24.980951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:24.981797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:24.982549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 33/72] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:26:24.983691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da224b6b-b020-41f5-9cf6-42e4f780eaaf None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:24.983977 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da224b6b-b020-41f5-9cf6-42e4f780eaaf None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:24.984251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da224b6b-b020-41f5-9cf6-42e4f780eaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:24.996468 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:25.002504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-da224b6b-b020-41f5-9cf6-42e4f780eaaf None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:25.003704 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-da224b6b-b020-41f5-9cf6-42e4f780eaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:25.006980 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c3307-fb78-4efe-9e08-220c25d7854a None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:25.042732 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f48d5-2b28-4b45-841e-95ec2f58f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:25.043340 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f48d5-2b28-4b45-841e-95ec2f58f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:25.043623 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f48d5-2b28-4b45-841e-95ec2f58f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:25.043897 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f48d5-2b28-4b45-841e-95ec2f58f6d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:25.044855 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f48d5-2b28-4b45-841e-95ec2f58f6d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:25.045163 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f48d5-2b28-4b45-841e-95ec2f58f6d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:25.046566 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f48d5-2b28-4b45-841e-95ec2f58f6d2 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:25.055022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 40/73] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:25.055832 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f48d5-2b28-4b45-841e-95ec2f58f6d2 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:25.076600 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 34/74] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:25.088323 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da224b6b-b020-41f5-9cf6-42e4f780eaaf None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:25.144033 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:25.165388 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f48d5-2b28-4b45-841e-95ec2f58f6d2 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:25.189860 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da224b6b-b020-41f5-9cf6-42e4f780eaaf None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:25.200319 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d187a8-44a3-433a-ba55-1e543bdf926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:25.200983 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d187a8-44a3-433a-ba55-1e543bdf926e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:25.201590 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d187a8-44a3-433a-ba55-1e543bdf926e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:25.201910 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d187a8-44a3-433a-ba55-1e543bdf926e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:25.214779 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d187a8-44a3-433a-ba55-1e543bdf926e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-79d187a8-44a3-433a-ba55-1e543bdf926e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:25.219895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:25.220741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:25.221528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 41/75] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:26:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:25.226040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d187a8-44a3-433a-ba55-1e543bdf926e None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:25.228162 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244e7b2-5d06-4343-a63d-28cefb3e1a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:25.228799 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244e7b2-5d06-4343-a63d-28cefb3e1a16 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:25.229080 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244e7b2-5d06-4343-a63d-28cefb3e1a16 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:25.229350 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244e7b2-5d06-4343-a63d-28cefb3e1a16 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:25.230011 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244e7b2-5d06-4343-a63d-28cefb3e1a16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:25.230312 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244e7b2-5d06-4343-a63d-28cefb3e1a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:25.231670 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244e7b2-5d06-4343-a63d-28cefb3e1a16 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:25.242912 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:25.244831 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 35/76] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:25.245651 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244e7b2-5d06-4343-a63d-28cefb3e1a16 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:25.336644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d187a8-44a3-433a-ba55-1e543bdf926e None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:25.357088 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244e7b2-5d06-4343-a63d-28cefb3e1a16 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:25.373178 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920aaeca-9dab-4d17-bb54-0e6e671a2ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:25.373798 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aaeca-9dab-4d17-bb54-0e6e671a2ca6 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:25.374079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aaeca-9dab-4d17-bb54-0e6e671a2ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:25.374356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aaeca-9dab-4d17-bb54-0e6e671a2ca6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:25.375659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:25.384423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920aaeca-9dab-4d17-bb54-0e6e671a2ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-920aaeca-9dab-4d17-bb54-0e6e671a2ca6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:25.389697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:25.392124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 42/77] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:25.392925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920aaeca-9dab-4d17-bb54-0e6e671a2ca6 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:25.398171 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1d71b-896c-4e11-b0e7-efb7fb4bf17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:25.398805 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1d71b-896c-4e11-b0e7-efb7fb4bf17a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:25.399085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1d71b-896c-4e11-b0e7-efb7fb4bf17a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:25.399356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1d71b-896c-4e11-b0e7-efb7fb4bf17a None admin] PATH_INFO: `/v3/users/764bfa213b604c20a8badf2dcbdd4fa7` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:25.414869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1d71b-896c-4e11-b0e7-efb7fb4bf17a None admin] RBAC: Authorizing `identity:get_user(user_id=764bfa213b604c20a8badf2dcbdd4fa7)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:25.416759 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1d71b-896c-4e11-b0e7-efb7fb4bf17a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:25.423065 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 36/78] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:25 2022] GET /identity/v3/users/764bfa213b604c20a8badf2dcbdd4fa7 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:25.423065 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1d71b-896c-4e11-b0e7-efb7fb4bf17a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:25.481706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:25.506958 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920aaeca-9dab-4d17-bb54-0e6e671a2ca6 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:25.525854 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1d71b-896c-4e11-b0e7-efb7fb4bf17a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:25.540350 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7917b54-6655-42a4-936c-3976b32d5823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:25.540992 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7917b54-6655-42a4-936c-3976b32d5823 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:25.541271 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7917b54-6655-42a4-936c-3976b32d5823 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:25.541549 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7917b54-6655-42a4-936c-3976b32d5823 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:25.542197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7917b54-6655-42a4-936c-3976b32d5823 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:25.542712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7917b54-6655-42a4-936c-3976b32d5823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:25.544030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7917b54-6655-42a4-936c-3976b32d5823 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:25.552882 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 43/79] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:26:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:25.554005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7917b54-6655-42a4-936c-3976b32d5823 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:25.564096 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f84c6-c69d-4e8a-b5e8-434d3fc810d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:25.564759 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f84c6-c69d-4e8a-b5e8-434d3fc810d7 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:25.565050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f84c6-c69d-4e8a-b5e8-434d3fc810d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:25.565326 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f84c6-c69d-4e8a-b5e8-434d3fc810d7 None admin] PATH_INFO: `/v3/users/4194ee18e96548d99ebb8f12d43b6b6f` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:25.566466 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f84c6-c69d-4e8a-b5e8-434d3fc810d7 None admin] RBAC: Authorizing `identity:get_user(user_id=4194ee18e96548d99ebb8f12d43b6b6f)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:25.567923 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f84c6-c69d-4e8a-b5e8-434d3fc810d7 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:25.569536 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 37/80] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:25 2022] GET /identity/v3/users/4194ee18e96548d99ebb8f12d43b6b6f => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:25.570327 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f84c6-c69d-4e8a-b5e8-434d3fc810d7 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:25.615961 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:25.664694 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7917b54-6655-42a4-936c-3976b32d5823 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:25.683607 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f84c6-c69d-4e8a-b5e8-434d3fc810d7 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:25.701247 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c2caf-4f9f-4c5f-94ce-64cce6112fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:25.701897 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c2caf-4f9f-4c5f-94ce-64cce6112fb7 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:25.721115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c2caf-4f9f-4c5f-94ce-64cce6112fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:25.721115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c2caf-4f9f-4c5f-94ce-64cce6112fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:25.721115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c2caf-4f9f-4c5f-94ce-64cce6112fb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:25.721115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c2caf-4f9f-4c5f-94ce-64cce6112fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:25.721115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c2caf-4f9f-4c5f-94ce-64cce6112fb7 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:25.721115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:25.721115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 44/81] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:25.721678 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c2caf-4f9f-4c5f-94ce-64cce6112fb7 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:25.721744 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f325d40-43eb-4301-8b79-03a62de37027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:25.722213 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f325d40-43eb-4301-8b79-03a62de37027 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:25.722520 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f325d40-43eb-4301-8b79-03a62de37027 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:25.722961 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f325d40-43eb-4301-8b79-03a62de37027 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:25.724093 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f325d40-43eb-4301-8b79-03a62de37027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:25.725587 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f325d40-43eb-4301-8b79-03a62de37027 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:25.727180 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 38/82] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:25.727989 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f325d40-43eb-4301-8b79-03a62de37027 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:25.816884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c2caf-4f9f-4c5f-94ce-64cce6112fb7 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:25.825561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f325d40-43eb-4301-8b79-03a62de37027 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:25.838396 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:25.849636 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f7d4-8db2-440f-b2d2-d92a1e9bb341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:25.851121 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f7d4-8db2-440f-b2d2-d92a1e9bb341 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:25.851121 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f7d4-8db2-440f-b2d2-d92a1e9bb341 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:25.851121 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632f7d4-8db2-440f-b2d2-d92a1e9bb341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:25.859166 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4722c1-e793-40d9-b1c3-6054b0109edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:25.859793 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4722c1-e793-40d9-b1c3-6054b0109edb None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:25.860072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4722c1-e793-40d9-b1c3-6054b0109edb None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:25.860343 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4722c1-e793-40d9-b1c3-6054b0109edb None admin] PATH_INFO: `/v3/users/764bfa213b604c20a8badf2dcbdd4fa7` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:25.861508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4722c1-e793-40d9-b1c3-6054b0109edb None admin] RBAC: Authorizing `identity:get_user(user_id=764bfa213b604c20a8badf2dcbdd4fa7)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:25.862946 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4722c1-e793-40d9-b1c3-6054b0109edb None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:25.864503 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 39/83] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:25 2022] GET /identity/v3/users/764bfa213b604c20a8badf2dcbdd4fa7 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:25.869782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4722c1-e793-40d9-b1c3-6054b0109edb None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:25.918316 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:25.922015 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632f7d4-8db2-440f-b2d2-d92a1e9bb341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:25.923490 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632f7d4-8db2-440f-b2d2-d92a1e9bb341 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:25.963779 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4722c1-e793-40d9-b1c3-6054b0109edb None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:25.998452 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea7ff4-fc01-4ab4-b287-eccb13fd0502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:25.999063 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7ff4-fc01-4ab4-b287-eccb13fd0502 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:25.999412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7ff4-fc01-4ab4-b287-eccb13fd0502 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:25.999720 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7ff4-fc01-4ab4-b287-eccb13fd0502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:26.025634 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 45/84] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:26.030942 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f7d4-8db2-440f-b2d2-d92a1e9bb341 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:26.051795 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:26.070462 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea7ff4-fc01-4ab4-b287-eccb13fd0502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:26.071879 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea7ff4-fc01-4ab4-b287-eccb13fd0502 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:26.126928 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:26.130858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632f7d4-8db2-440f-b2d2-d92a1e9bb341 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:26.165026 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848a00e-d530-46e4-a9c8-664b9c827a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:26.166267 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848a00e-d530-46e4-a9c8-664b9c827a11 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:26.166831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848a00e-d530-46e4-a9c8-664b9c827a11 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:26.166831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848a00e-d530-46e4-a9c8-664b9c827a11 None admin] PATH_INFO: `/v3/users/764bfa213b604c20a8badf2dcbdd4fa7` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:26.167911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848a00e-d530-46e4-a9c8-664b9c827a11 None admin] RBAC: Authorizing `identity:get_user(user_id=764bfa213b604c20a8badf2dcbdd4fa7)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:26.168898 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 40/85] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:26.170063 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea7ff4-fc01-4ab4-b287-eccb13fd0502 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:26.172795 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848a00e-d530-46e4-a9c8-664b9c827a11 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:26.175227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 46/86] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:26 2022] GET /identity/v3/users/764bfa213b604c20a8badf2dcbdd4fa7 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:26.176051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848a00e-d530-46e4-a9c8-664b9c827a11 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:26.247633 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:26.267434 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea7ff4-fc01-4ab4-b287-eccb13fd0502 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:26.273661 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848a00e-d530-46e4-a9c8-664b9c827a11 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:26.301593 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698fc80-3519-4caf-878a-f549bd469eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:26.302203 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698fc80-3519-4caf-878a-f549bd469eb9 None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:26.302487 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698fc80-3519-4caf-878a-f549bd469eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:26.302763 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698fc80-3519-4caf-878a-f549bd469eb9 None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:26.303400 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698fc80-3519-4caf-878a-f549bd469eb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:26.304890 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698fc80-3519-4caf-878a-f549bd469eb9 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:26.308372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0388f-cf73-4d3f-bd34-c58b297a18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:26.308998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0388f-cf73-4d3f-bd34-c58b297a18d3 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:26.309280 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0388f-cf73-4d3f-bd34-c58b297a18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:26.309552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0388f-cf73-4d3f-bd34-c58b297a18d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:26.343082 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:26.382192 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0388f-cf73-4d3f-bd34-c58b297a18d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:26.383694 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0388f-cf73-4d3f-bd34-c58b297a18d3 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:26.395653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 41/87] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 19 17:26:26 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:26:26.397191 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698fc80-3519-4caf-878a-f549bd469eb9 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:26.505464 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 47/88] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:26.505464 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0388f-cf73-4d3f-bd34-c58b297a18d3 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:26.527969 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698fc80-3519-4caf-878a-f549bd469eb9 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:26.569192 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4269e3-cd42-4313-b562-895be28c5843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:26.569827 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4269e3-cd42-4313-b562-895be28c5843 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:26.570151 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4269e3-cd42-4313-b562-895be28c5843 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:26.570419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4269e3-cd42-4313-b562-895be28c5843 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:26.571512 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4269e3-cd42-4313-b562-895be28c5843 None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:26.573537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4269e3-cd42-4313-b562-895be28c5843 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:26.573788 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:26.575314 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 42/89] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:26 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:26.575979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4269e3-cd42-4313-b562-895be28c5843 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:26.582001 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:26.619224 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0388f-cf73-4d3f-bd34-c58b297a18d3 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:26.665373 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fce8b-86b5-4c9e-a60f-43fe99c77f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:26.666441 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fce8b-86b5-4c9e-a60f-43fe99c77f22 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:26.666441 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fce8b-86b5-4c9e-a60f-43fe99c77f22 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:26.666441 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fce8b-86b5-4c9e-a60f-43fe99c77f22 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:26.667623 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fce8b-86b5-4c9e-a60f-43fe99c77f22 None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:26.669112 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fce8b-86b5-4c9e-a60f-43fe99c77f22 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:26.671313 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 48/90] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:26 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:26.672877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fce8b-86b5-4c9e-a60f-43fe99c77f22 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:26.709683 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4269e3-cd42-4313-b562-895be28c5843 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:26.750403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5df718-3dfb-4a7c-a016-e2556524af59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:26.751015 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5df718-3dfb-4a7c-a016-e2556524af59 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:26.751296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5df718-3dfb-4a7c-a016-e2556524af59 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:26.751570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5df718-3dfb-4a7c-a016-e2556524af59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:26.806258 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fce8b-86b5-4c9e-a60f-43fe99c77f22 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:26.839226 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5df718-3dfb-4a7c-a016-e2556524af59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:26.842006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5df718-3dfb-4a7c-a016-e2556524af59 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:26.846781 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:26.849175 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b080fc-3e72-4289-98b2-bc37a571d35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:26.849807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b080fc-3e72-4289-98b2-bc37a571d35e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:26.850193 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b080fc-3e72-4289-98b2-bc37a571d35e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:26.850465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b080fc-3e72-4289-98b2-bc37a571d35e None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:26.851591 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b080fc-3e72-4289-98b2-bc37a571d35e None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:26.853194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b080fc-3e72-4289-98b2-bc37a571d35e None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:26.855079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 49/91] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:26 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:26.860650 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b080fc-3e72-4289-98b2-bc37a571d35e None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:26.860650 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:26.969236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b080fc-3e72-4289-98b2-bc37a571d35e None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:26.977426 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 43/92] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:26.978564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5df718-3dfb-4a7c-a016-e2556524af59 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:27.011722 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0066d8-ff14-45b7-a79f-ae9acb93c3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:27.012338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0066d8-ff14-45b7-a79f-ae9acb93c3a4 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:27.012620 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0066d8-ff14-45b7-a79f-ae9acb93c3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:27.012922 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0066d8-ff14-45b7-a79f-ae9acb93c3a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:27.014071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0066d8-ff14-45b7-a79f-ae9acb93c3a4 None admin] RBAC: Adding query filter params (role.id=f81ebe87e8a74c24a390dbaafdacdbce, scope.project.id=1819a9eb8b794d41999ed4c6e858aa28, user.id=764bfa213b604c20a8badf2dcbdd4fa7) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:27.014384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0066d8-ff14-45b7-a79f-ae9acb93c3a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:27.015981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0066d8-ff14-45b7-a79f-ae9acb93c3a4 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:27.021896 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 50/93] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:26 2022] GET /identity/v3/role_assignments?user.id=764bfa213b604c20a8badf2dcbdd4fa7&scope.project.id=1819a9eb8b794d41999ed4c6e858aa28&role.id=f81ebe87e8a74c24a390dbaafdacdbce => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:27.029444 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0066d8-ff14-45b7-a79f-ae9acb93c3a4 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:27.103272 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5df718-3dfb-4a7c-a016-e2556524af59 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:27.107676 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:27.145480 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:27.241964 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3e7d4-b38c-4a9a-9a80-0150e9e83c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:27.242502 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3e7d4-b38c-4a9a-9a80-0150e9e83c2a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:27.242781 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3e7d4-b38c-4a9a-9a80-0150e9e83c2a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:27.243788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3e7d4-b38c-4a9a-9a80-0150e9e83c2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:27.244780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3e7d4-b38c-4a9a-9a80-0150e9e83c2a None admin] RBAC: Adding query filter params (role.id=17791940429e48ac98d4bd49aa53a88c, scope.project.id=1819a9eb8b794d41999ed4c6e858aa28, user.id=4194ee18e96548d99ebb8f12d43b6b6f) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:27.246207 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3e7d4-b38c-4a9a-9a80-0150e9e83c2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:27.248389 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3e7d4-b38c-4a9a-9a80-0150e9e83c2a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:27.253064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0066d8-ff14-45b7-a79f-ae9acb93c3a4 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:27.265328 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 44/94] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:26 2022] GET /identity/v3/role_assignments?user.id=4194ee18e96548d99ebb8f12d43b6b6f&scope.project.id=1819a9eb8b794d41999ed4c6e858aa28&role.id=17791940429e48ac98d4bd49aa53a88c => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:27.267117 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3e7d4-b38c-4a9a-9a80-0150e9e83c2a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:27.324868 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444f338-1427-4eea-9524-1dd75458122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:27.325476 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444f338-1427-4eea-9524-1dd75458122d None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:27.325754 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444f338-1427-4eea-9524-1dd75458122d None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:27.326026 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444f338-1427-4eea-9524-1dd75458122d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:27.326747 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444f338-1427-4eea-9524-1dd75458122d None admin] RBAC: Adding query filter params (role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1, scope.project.id=1819a9eb8b794d41999ed4c6e858aa28, user.id=764bfa213b604c20a8badf2dcbdd4fa7) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:27.327057 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444f338-1427-4eea-9524-1dd75458122d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:27.328528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444f338-1427-4eea-9524-1dd75458122d None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:27.352886 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 51/95] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:27 2022] GET /identity/v3/role_assignments?user.id=764bfa213b604c20a8badf2dcbdd4fa7&scope.project.id=1819a9eb8b794d41999ed4c6e858aa28&role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1 => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:27.450347 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3e7d4-b38c-4a9a-9a80-0150e9e83c2a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:27.492165 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddeaf3-0779-4274-a684-d517fe6da07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:27.492764 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddeaf3-0779-4274-a684-d517fe6da07c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:27.493048 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddeaf3-0779-4274-a684-d517fe6da07c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:27.493383 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddeaf3-0779-4274-a684-d517fe6da07c None admin] PATH_INFO: `/v3/projects/b5c0ceed4b9843fa909c39d6ed10a972` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:27.495501 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddeaf3-0779-4274-a684-d517fe6da07c None admin] RBAC: Authorizing `identity:get_project(project_id=b5c0ceed4b9843fa909c39d6ed10a972)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:27.497028 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddeaf3-0779-4274-a684-d517fe6da07c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:27.499163 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 45/96] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:27 2022] GET /identity/v3/projects/b5c0ceed4b9843fa909c39d6ed10a972 => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:27.504756 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444f338-1427-4eea-9524-1dd75458122d None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:27.638471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444f338-1427-4eea-9524-1dd75458122d None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:27.667683 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:27.677465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cb836-441a-4c59-a854-e18e318982fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:27.678081 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cb836-441a-4c59-a854-e18e318982fb None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:27.678359 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cb836-441a-4c59-a854-e18e318982fb None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:27.678631 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cb836-441a-4c59-a854-e18e318982fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:27.679365 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cb836-441a-4c59-a854-e18e318982fb None admin] RBAC: Adding query filter params (role.id=f81ebe87e8a74c24a390dbaafdacdbce, scope.project.id=b5c0ceed4b9843fa909c39d6ed10a972, user.id=764bfa213b604c20a8badf2dcbdd4fa7) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:27.679669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cb836-441a-4c59-a854-e18e318982fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:27.681197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cb836-441a-4c59-a854-e18e318982fb None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:27.688859 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 52/97] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:27 2022] GET /identity/v3/role_assignments?user.id=764bfa213b604c20a8badf2dcbdd4fa7&scope.project.id=b5c0ceed4b9843fa909c39d6ed10a972&role.id=f81ebe87e8a74c24a390dbaafdacdbce => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:29.194963 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac3e67-1344-4403-b4db-271e5c4c9ad4 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:29.195480 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac3e67-1344-4403-b4db-271e5c4c9ad4 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:29.195480 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac3e67-1344-4403-b4db-271e5c4c9ad4 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:29.196846 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 46/98] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:29.218914 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10201670-6cf8-45b1-b4ff-4a17e559e072 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:29.219498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10201670-6cf8-45b1-b4ff-4a17e559e072 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:29.219498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10201670-6cf8-45b1-b4ff-4a17e559e072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:29.239613 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-10201670-6cf8-45b1-b4ff-4a17e559e072 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:29.240821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-10201670-6cf8-45b1-b4ff-4a17e559e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:29.319149 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 53/99] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:29.730676 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7096-f47d-4bfc-b044-b89ecd0c87ed None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:29.731052 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7096-f47d-4bfc-b044-b89ecd0c87ed None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:29.731229 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7096-f47d-4bfc-b044-b89ecd0c87ed None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:29.732617 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 47/100] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:29.747256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576ac53-ec78-4415-87b6-385ba61d0105 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:29.747539 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576ac53-ec78-4415-87b6-385ba61d0105 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:29.747815 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576ac53-ec78-4415-87b6-385ba61d0105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:29.770848 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-6576ac53-ec78-4415-87b6-385ba61d0105 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:29.772043 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-6576ac53-ec78-4415-87b6-385ba61d0105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:29.879170 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 54/101] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:30.005567 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7096-f47d-4bfc-b044-b89ecd0c87ed None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:30.053635 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:30.136928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7096-f47d-4bfc-b044-b89ecd0c87ed None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:30.262096 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4e937-3b26-4600-811f-b6a6107cbc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:30.263505 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4e937-3b26-4600-811f-b6a6107cbc3b None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:30.264026 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4e937-3b26-4600-811f-b6a6107cbc3b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:30.264496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4e937-3b26-4600-811f-b6a6107cbc3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:30.285654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4e937-3b26-4600-811f-b6a6107cbc3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-74c4e937-3b26-4600-811f-b6a6107cbc3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:30.290709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:30.291609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:30.292373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:30.292373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:30.292373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:30.292373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:30.292373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:30.292373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:30.292373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:30.292373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:30.292373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:30.292373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:30.292373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:30.292373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:30.294606 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 48/102] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:30.300929 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576ac53-ec78-4415-87b6-385ba61d0105 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:30.307588 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4e937-3b26-4600-811f-b6a6107cbc3b None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:30.434864 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:30.444200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4e937-3b26-4600-811f-b6a6107cbc3b None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:30.448591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:30.485519 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbb69f-a0ee-4b30-918b-b7fb824cf089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:30.486421 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb69f-a0ee-4b30-918b-b7fb824cf089 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:30.486846 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb69f-a0ee-4b30-918b-b7fb824cf089 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:30.487294 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb69f-a0ee-4b30-918b-b7fb824cf089 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:30.488766 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbb69f-a0ee-4b30-918b-b7fb824cf089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:30.491228 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbb69f-a0ee-4b30-918b-b7fb824cf089 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:30.493225 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 49/103] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:30.495645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200e4fa-3f2d-4f45-8b78-7092ebe5203c None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:30.496954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200e4fa-3f2d-4f45-8b78-7092ebe5203c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:30.496954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200e4fa-3f2d-4f45-8b78-7092ebe5203c None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:30.498078 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 50/104] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:30.504038 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200e4fa-3f2d-4f45-8b78-7092ebe5203c None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:30.599693 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576ac53-ec78-4415-87b6-385ba61d0105 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:30.622282 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200e4fa-3f2d-4f45-8b78-7092ebe5203c None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:30.650558 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b53db7-bf76-4682-8f87-26ba686277da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:30.651460 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53db7-bf76-4682-8f87-26ba686277da None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:30.651885 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53db7-bf76-4682-8f87-26ba686277da None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:30.652354 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b53db7-bf76-4682-8f87-26ba686277da None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:30.654019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b53db7-bf76-4682-8f87-26ba686277da None admin] RBAC: Adding query filter params (name=reader) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:30.654508 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b53db7-bf76-4682-8f87-26ba686277da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:30.656420 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b53db7-bf76-4682-8f87-26ba686277da None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:30.669449 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 55/105] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:30.670687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97af52-f2c5-441d-88b8-4df72ba38815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:30.671479 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97af52-f2c5-441d-88b8-4df72ba38815 None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:30.671762 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f4de-4650-4aac-bc4f-2590796bbf4f None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:30.671940 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97af52-f2c5-441d-88b8-4df72ba38815 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:30.672311 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97af52-f2c5-441d-88b8-4df72ba38815 None admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:30.672471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f4de-4650-4aac-bc4f-2590796bbf4f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:30.672925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f4de-4650-4aac-bc4f-2590796bbf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:30.673428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97af52-f2c5-441d-88b8-4df72ba38815 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:30.675021 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97af52-f2c5-441d-88b8-4df72ba38815 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:30.694370 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-1976f4de-4650-4aac-bc4f-2590796bbf4f None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:30.695879 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-1976f4de-4650-4aac-bc4f-2590796bbf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:30.767977 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 56/106] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:30.769598 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3dd1d-d1e9-48c0-bba3-055900fec76e None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:30.770020 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3dd1d-d1e9-48c0-bba3-055900fec76e None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:30.770415 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3dd1d-d1e9-48c0-bba3-055900fec76e None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:30.771805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 57/107] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:30.772643 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3dd1d-d1e9-48c0-bba3-055900fec76e None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:30.795351 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 51/108] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 19 17:26:30 2022] POST /identity/v3/projects => generated 302 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:26:30.800212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77206aa-0aa2-4d7a-90e1-f7db1e4ac6c2 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:30.800802 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77206aa-0aa2-4d7a-90e1-f7db1e4ac6c2 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:30.801281 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77206aa-0aa2-4d7a-90e1-f7db1e4ac6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:30.830527 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:30.841909 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-f77206aa-0aa2-4d7a-90e1-f7db1e4ac6c2 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:30.843608 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-f77206aa-0aa2-4d7a-90e1-f7db1e4ac6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:30.896037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:30.896454 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3dd1d-d1e9-48c0-bba3-055900fec76e None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:30.977564 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0de911-130d-4615-a3bb-826a4aa5c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:30.978229 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0de911-130d-4615-a3bb-826a4aa5c133 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:30.979052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0de911-130d-4615-a3bb-826a4aa5c133 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:30.979330 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0de911-130d-4615-a3bb-826a4aa5c133 None admin] PATH_INFO: `/v3/users/69c4ff647e4b4cac85f3ac5894b344ab` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:30.998984 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 52/109] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:31.000280 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a1526-03fa-4467-b0cf-35ccdf191e36 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:31.000572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a1526-03fa-4467-b0cf-35ccdf191e36 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:31.000887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a1526-03fa-4467-b0cf-35ccdf191e36 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:31.004314 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 53/110] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:31.010101 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2bd1-2630-4397-a37e-5632fd3d4495 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:31.011584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2bd1-2630-4397-a37e-5632fd3d4495 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:31.011584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2bd1-2630-4397-a37e-5632fd3d4495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:31.015722 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0de911-130d-4615-a3bb-826a4aa5c133 None admin] RBAC: Authorizing `identity:get_user(user_id=69c4ff647e4b4cac85f3ac5894b344ab)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:31.017258 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0de911-130d-4615-a3bb-826a4aa5c133 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:31.019177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 58/111] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:30 2022] GET /identity/v3/users/69c4ff647e4b4cac85f3ac5894b344ab => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:31.025366 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0de911-130d-4615-a3bb-826a4aa5c133 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:31.048566 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-4e9f2bd1-2630-4397-a37e-5632fd3d4495 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:31.049823 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-4e9f2bd1-2630-4397-a37e-5632fd3d4495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:31.139768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0de911-130d-4615-a3bb-826a4aa5c133 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:31.142174 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:31.176594 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 54/112] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:31.178943 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dbfe8-acca-40a1-b912-891fe977a61d None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:31.180870 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dbfe8-acca-40a1-b912-891fe977a61d None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:31.181338 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dbfe8-acca-40a1-b912-891fe977a61d None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:31.183361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 55/113] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:31.191187 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3785d1-8d0f-4c4a-b5f0-42bb9ca072ee None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:31.192128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3785d1-8d0f-4c4a-b5f0-42bb9ca072ee None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:31.192575 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3785d1-8d0f-4c4a-b5f0-42bb9ca072ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:31.198091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c7949-eb50-44e7-aad4-1114c675f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:31.198886 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7949-eb50-44e7-aad4-1114c675f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:31.199928 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7949-eb50-44e7-aad4-1114c675f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:31.200359 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c7949-eb50-44e7-aad4-1114c675f1e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:31.225942 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-8c3785d1-8d0f-4c4a-b5f0-42bb9ca072ee None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:31.229297 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-8c3785d1-8d0f-4c4a-b5f0-42bb9ca072ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:31.314378 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c7949-eb50-44e7-aad4-1114c675f1e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:31.316244 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c7949-eb50-44e7-aad4-1114c675f1e2 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:31.330680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 56/114] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:31.332074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3785d1-8d0f-4c4a-b5f0-42bb9ca072ee None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:31.347617 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:31.510249 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 59/115] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:31.511045 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c7949-eb50-44e7-aad4-1114c675f1e2 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:31.518172 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:31.536580 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3785d1-8d0f-4c4a-b5f0-42bb9ca072ee None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:31.575634 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dc342-7d2a-42a6-bc2a-8ad644a9ad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:31.576279 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dc342-7d2a-42a6-bc2a-8ad644a9ad69 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:31.576563 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dc342-7d2a-42a6-bc2a-8ad644a9ad69 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:31.576909 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dc342-7d2a-42a6-bc2a-8ad644a9ad69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:31.589023 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920dc342-7d2a-42a6-bc2a-8ad644a9ad69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-920dc342-7d2a-42a6-bc2a-8ad644a9ad69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:31.593950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:31.594840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:31.595690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 57/116] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:26:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:31.596343 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dc342-7d2a-42a6-bc2a-8ad644a9ad69 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:31.639673 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c7949-eb50-44e7-aad4-1114c675f1e2 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:31.672484 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:31.677182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a97b61-c517-4040-81fc-bc006283a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:31.677809 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a97b61-c517-4040-81fc-bc006283a797 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:31.678087 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a97b61-c517-4040-81fc-bc006283a797 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:31.678355 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a97b61-c517-4040-81fc-bc006283a797 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:31.689239 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a97b61-c517-4040-81fc-bc006283a797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-05a97b61-c517-4040-81fc-bc006283a797 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:31.694052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:31.696506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 60/117] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:26:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:31.699080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a97b61-c517-4040-81fc-bc006283a797 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:31.729679 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dc342-7d2a-42a6-bc2a-8ad644a9ad69 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:31.772092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526bccb-9722-4b5a-bc52-11e0974a986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:31.772830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526bccb-9722-4b5a-bc52-11e0974a986f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:31.773115 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526bccb-9722-4b5a-bc52-11e0974a986f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:31.773394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526bccb-9722-4b5a-bc52-11e0974a986f None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:31.775019 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526bccb-9722-4b5a-bc52-11e0974a986f None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:31.776894 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526bccb-9722-4b5a-bc52-11e0974a986f None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:31.777628 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:31.779278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 58/118] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:31 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:31.779970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526bccb-9722-4b5a-bc52-11e0974a986f None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:31.824593 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a97b61-c517-4040-81fc-bc006283a797 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:31.860803 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58916e8-3102-43e6-aabc-796c477f283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:31.861411 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58916e8-3102-43e6-aabc-796c477f283a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:31.861696 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58916e8-3102-43e6-aabc-796c477f283a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:31.861971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58916e8-3102-43e6-aabc-796c477f283a None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:31.862656 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58916e8-3102-43e6-aabc-796c477f283a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:31.862960 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58916e8-3102-43e6-aabc-796c477f283a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:31.864345 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58916e8-3102-43e6-aabc-796c477f283a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:31.873200 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 61/119] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:31.877694 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58916e8-3102-43e6-aabc-796c477f283a None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:31.889474 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526bccb-9722-4b5a-bc52-11e0974a986f None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:31.923863 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5da38e-132d-4c0a-a189-7295fc0942c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:31.924489 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5da38e-132d-4c0a-a189-7295fc0942c1 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:31.924795 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5da38e-132d-4c0a-a189-7295fc0942c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:31.925073 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5da38e-132d-4c0a-a189-7295fc0942c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:31.927080 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:31.936337 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5da38e-132d-4c0a-a189-7295fc0942c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-3f5da38e-132d-4c0a-a189-7295fc0942c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:31.946930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:31.948010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 59/120] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:31.949090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5da38e-132d-4c0a-a189-7295fc0942c1 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:31.994851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58916e8-3102-43e6-aabc-796c477f283a None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:32.022253 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:32.031543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e927a-5bf9-4e63-bb56-1dee2eb7ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:32.032148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e927a-5bf9-4e63-bb56-1dee2eb7ab58 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:32.032446 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e927a-5bf9-4e63-bb56-1dee2eb7ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:32.032700 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e927a-5bf9-4e63-bb56-1dee2eb7ab58 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:32.033463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e927a-5bf9-4e63-bb56-1dee2eb7ab58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:32.033771 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e927a-5bf9-4e63-bb56-1dee2eb7ab58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:32.035188 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e927a-5bf9-4e63-bb56-1dee2eb7ab58 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:32.048086 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 62/121] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:26:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:32.048086 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e927a-5bf9-4e63-bb56-1dee2eb7ab58 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:32.060767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5da38e-132d-4c0a-a189-7295fc0942c1 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:32.097171 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f94ab-6298-4fcf-ac14-c4f044e5df0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:32.097826 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f94ab-6298-4fcf-ac14-c4f044e5df0f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:32.098109 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f94ab-6298-4fcf-ac14-c4f044e5df0f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:32.098381 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f94ab-6298-4fcf-ac14-c4f044e5df0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:32.111783 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f94ab-6298-4fcf-ac14-c4f044e5df0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-e57f94ab-6298-4fcf-ac14-c4f044e5df0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:32.117850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:32.118701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:32.119449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:32.119449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:32.119449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:32.119449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:32.119449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:32.119449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:32.119449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:32.119449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:32.119449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:32.119449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:32.119449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:32.119449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:32.120992 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 60/122] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:32.121774 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f94ab-6298-4fcf-ac14-c4f044e5df0f None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:32.165611 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e927a-5bf9-4e63-bb56-1dee2eb7ab58 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:32.179052 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:32.205437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b6a45-d6e8-42a0-be39-bfa1e1407e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:32.206131 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b6a45-d6e8-42a0-be39-bfa1e1407e07 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:32.206581 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b6a45-d6e8-42a0-be39-bfa1e1407e07 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:32.206699 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b6a45-d6e8-42a0-be39-bfa1e1407e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:32.207434 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b6a45-d6e8-42a0-be39-bfa1e1407e07 None admin] RBAC: Adding query filter params (role.id=783aa30fbf304861957e0d234b935acf, scope.project.id=1819a9eb8b794d41999ed4c6e858aa28, user.id=69c4ff647e4b4cac85f3ac5894b344ab) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:32.207694 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b6a45-d6e8-42a0-be39-bfa1e1407e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:32.209163 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b6a45-d6e8-42a0-be39-bfa1e1407e07 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:32.218324 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 63/123] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:32 2022] GET /identity/v3/role_assignments?user.id=69c4ff647e4b4cac85f3ac5894b344ab&scope.project.id=1819a9eb8b794d41999ed4c6e858aa28&role.id=783aa30fbf304861957e0d234b935acf => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:32.219620 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b6a45-d6e8-42a0-be39-bfa1e1407e07 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:32.225986 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f94ab-6298-4fcf-ac14-c4f044e5df0f None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:32.268158 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a798c9-904a-4c0b-be3e-0b6180bfbcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:32.269141 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a798c9-904a-4c0b-be3e-0b6180bfbcbd None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:32.269562 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a798c9-904a-4c0b-be3e-0b6180bfbcbd None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:32.269992 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a798c9-904a-4c0b-be3e-0b6180bfbcbd None admin] PATH_INFO: `/v3/users/4194ee18e96548d99ebb8f12d43b6b6f` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:32.271473 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a798c9-904a-4c0b-be3e-0b6180bfbcbd None admin] RBAC: Authorizing `identity:get_user(user_id=4194ee18e96548d99ebb8f12d43b6b6f)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:32.273058 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a798c9-904a-4c0b-be3e-0b6180bfbcbd None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:32.274630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 61/124] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:32 2022] GET /identity/v3/users/4194ee18e96548d99ebb8f12d43b6b6f => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:32.275449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a798c9-904a-4c0b-be3e-0b6180bfbcbd None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:32.293767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:32.357744 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b6a45-d6e8-42a0-be39-bfa1e1407e07 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:32.397930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a798c9-904a-4c0b-be3e-0b6180bfbcbd None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:32.414791 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3e99-4dad-495c-b173-0dd2173448bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:32.418817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3e99-4dad-495c-b173-0dd2173448bc None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:32.418817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3e99-4dad-495c-b173-0dd2173448bc None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:32.418817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3e99-4dad-495c-b173-0dd2173448bc None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:32.418817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff3e99-4dad-495c-b173-0dd2173448bc None admin] RBAC: Adding query filter params (name=member) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:32.420638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff3e99-4dad-495c-b173-0dd2173448bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:32.421877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff3e99-4dad-495c-b173-0dd2173448bc None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:32.433768 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:32.437320 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 64/125] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:32.439677 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3e99-4dad-495c-b173-0dd2173448bc None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:32.449950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f2fe2-4f1f-4260-b42d-922f8db0a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:32.450840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f2fe2-4f1f-4260-b42d-922f8db0a511 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:32.451758 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f2fe2-4f1f-4260-b42d-922f8db0a511 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:32.452190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f2fe2-4f1f-4260-b42d-922f8db0a511 None admin] PATH_INFO: `/v3/users/764bfa213b604c20a8badf2dcbdd4fa7` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:32.453983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f2fe2-4f1f-4260-b42d-922f8db0a511 None admin] RBAC: Authorizing `identity:get_user(user_id=764bfa213b604c20a8badf2dcbdd4fa7)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:32.456169 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f2fe2-4f1f-4260-b42d-922f8db0a511 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:32.458334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 62/126] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:32 2022] GET /identity/v3/users/764bfa213b604c20a8badf2dcbdd4fa7 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:32.459796 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f2fe2-4f1f-4260-b42d-922f8db0a511 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:32.553482 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3e99-4dad-495c-b173-0dd2173448bc None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:32.568968 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:32.590711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac6d71-d1dd-4259-85cc-85decd95239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:32.591312 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac6d71-d1dd-4259-85cc-85decd95239d None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:32.591595 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac6d71-d1dd-4259-85cc-85decd95239d None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:32.591868 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac6d71-d1dd-4259-85cc-85decd95239d None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:32.592524 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac6d71-d1dd-4259-85cc-85decd95239d None admin] RBAC: Adding query filter params (name=member) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:32.592857 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac6d71-d1dd-4259-85cc-85decd95239d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:32.594314 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac6d71-d1dd-4259-85cc-85decd95239d None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:32.602121 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f2fe2-4f1f-4260-b42d-922f8db0a511 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:32.608632 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 65/127] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:32.609608 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac6d71-d1dd-4259-85cc-85decd95239d None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:32.649627 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92bd2e-f83a-4fbb-b1c5-7cbe19cdf7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:32.650668 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92bd2e-f83a-4fbb-b1c5-7cbe19cdf7ac None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:32.651149 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92bd2e-f83a-4fbb-b1c5-7cbe19cdf7ac None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:32.652159 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92bd2e-f83a-4fbb-b1c5-7cbe19cdf7ac None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:32.653511 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92bd2e-f83a-4fbb-b1c5-7cbe19cdf7ac None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:32.656133 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92bd2e-f83a-4fbb-b1c5-7cbe19cdf7ac None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:32.658506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 63/128] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:32 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:32.664326 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92bd2e-f83a-4fbb-b1c5-7cbe19cdf7ac None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:32.725837 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:32.744971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac6d71-d1dd-4259-85cc-85decd95239d None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:32.770068 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92bd2e-f83a-4fbb-b1c5-7cbe19cdf7ac None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:32.798475 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448679-a689-4a8a-9d96-0621b87ce14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:32.799697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448679-a689-4a8a-9d96-0621b87ce14d None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:32.800628 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448679-a689-4a8a-9d96-0621b87ce14d None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:32.801404 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448679-a689-4a8a-9d96-0621b87ce14d None admin] PATH_INFO: `/v3/users/764bfa213b604c20a8badf2dcbdd4fa7` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:32.803012 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29448679-a689-4a8a-9d96-0621b87ce14d None admin] RBAC: Authorizing `identity:get_user(user_id=764bfa213b604c20a8badf2dcbdd4fa7)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:32.805711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29448679-a689-4a8a-9d96-0621b87ce14d None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:32.807722 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 66/129] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:32 2022] GET /identity/v3/users/764bfa213b604c20a8badf2dcbdd4fa7 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:32.808570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa5fa-5ad1-4891-a519-7508650b749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:32.808919 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448679-a689-4a8a-9d96-0621b87ce14d None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:32.809509 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa5fa-5ad1-4891-a519-7508650b749e None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:32.809860 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa5fa-5ad1-4891-a519-7508650b749e None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:32.810297 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa5fa-5ad1-4891-a519-7508650b749e None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:32.811491 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaa5fa-5ad1-4891-a519-7508650b749e None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:32.813392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaa5fa-5ad1-4891-a519-7508650b749e None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:32.815396 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 64/130] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:32 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:32.816299 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa5fa-5ad1-4891-a519-7508650b749e None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:32.871805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:32.932667 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa5fa-5ad1-4891-a519-7508650b749e None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:32.941054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448679-a689-4a8a-9d96-0621b87ce14d None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:32.965142 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:32.976475 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e0f84-af38-4977-94e1-a820cf20f3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:32.977334 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8844699-7829-48db-a760-7237e222c457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:32.977686 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e0f84-af38-4977-94e1-a820cf20f3f5 None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:32.980838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844699-7829-48db-a760-7237e222c457 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:32.980935 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e0f84-af38-4977-94e1-a820cf20f3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:32.980935 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e0f84-af38-4977-94e1-a820cf20f3f5 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28/users/4194ee18e96548d99ebb8f12d43b6b6f/roles/17791940429e48ac98d4bd49aa53a88c` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:32.981080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844699-7829-48db-a760-7237e222c457 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:32.981080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844699-7829-48db-a760-7237e222c457 None admin] PATH_INFO: `/v3/users/764bfa213b604c20a8badf2dcbdd4fa7` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:32.981080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8844699-7829-48db-a760-7237e222c457 None admin] RBAC: Authorizing `identity:get_user(user_id=764bfa213b604c20a8badf2dcbdd4fa7)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:32.981755 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e0f84-af38-4977-94e1-a820cf20f3f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1819a9eb8b794d41999ed4c6e858aa28, user_id=4194ee18e96548d99ebb8f12d43b6b6f, role_id=17791940429e48ac98d4bd49aa53a88c)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:32.982130 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8844699-7829-48db-a760-7237e222c457 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:32.983601 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e0f84-af38-4977-94e1-a820cf20f3f5 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:32.988377 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 67/131] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:32 2022] GET /identity/v3/users/764bfa213b604c20a8badf2dcbdd4fa7 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:32.989279 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8844699-7829-48db-a760-7237e222c457 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:33.057226 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 65/132] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:26:32 2022] PUT /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28/users/4194ee18e96548d99ebb8f12d43b6b6f/roles/17791940429e48ac98d4bd49aa53a88c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:26:33.062177 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e0f84-af38-4977-94e1-a820cf20f3f5 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:33.136924 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8844699-7829-48db-a760-7237e222c457 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:33.170748 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:33.218870 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4512b7-ab9b-4d88-9cf1-d5138d268443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:33.219533 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4512b7-ab9b-4d88-9cf1-d5138d268443 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:33.219812 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4512b7-ab9b-4d88-9cf1-d5138d268443 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:33.220082 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4512b7-ab9b-4d88-9cf1-d5138d268443 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:33.222477 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4512b7-ab9b-4d88-9cf1-d5138d268443 None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:33.227858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4512b7-ab9b-4d88-9cf1-d5138d268443 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:33.230201 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 68/133] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:32 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:33.231163 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4512b7-ab9b-4d88-9cf1-d5138d268443 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:33.311935 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e0f84-af38-4977-94e1-a820cf20f3f5 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:33.356497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02e874-ce79-4d6c-983d-8619aceafaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:33.357196 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02e874-ce79-4d6c-983d-8619aceafaee None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:33.357473 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02e874-ce79-4d6c-983d-8619aceafaee None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:33.357745 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02e874-ce79-4d6c-983d-8619aceafaee None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28/users/764bfa213b604c20a8badf2dcbdd4fa7/roles/d7e1e74a1b2f48319ddb2eadb4ffa9a1` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:33.358547 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4512b7-ab9b-4d88-9cf1-d5138d268443 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:33.359902 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02e874-ce79-4d6c-983d-8619aceafaee None admin] RBAC: Authorizing `identity:create_grant(project_id=1819a9eb8b794d41999ed4c6e858aa28, user_id=764bfa213b604c20a8badf2dcbdd4fa7, role_id=d7e1e74a1b2f48319ddb2eadb4ffa9a1)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:33.363330 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02e874-ce79-4d6c-983d-8619aceafaee None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:33.411274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea3fbb-ba63-4ca3-8e90-1a86ac41919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:33.412228 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea3fbb-ba63-4ca3-8e90-1a86ac41919e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:33.412711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea3fbb-ba63-4ca3-8e90-1a86ac41919e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:33.413176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea3fbb-ba63-4ca3-8e90-1a86ac41919e None admin] PATH_INFO: `/v3/projects/b5c0ceed4b9843fa909c39d6ed10a972` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:33.414508 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea3fbb-ba63-4ca3-8e90-1a86ac41919e None admin] RBAC: Authorizing `identity:get_project(project_id=b5c0ceed4b9843fa909c39d6ed10a972)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:33.416176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea3fbb-ba63-4ca3-8e90-1a86ac41919e None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:33.418622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 69/134] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:33 2022] GET /identity/v3/projects/b5c0ceed4b9843fa909c39d6ed10a972 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:33.419518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea3fbb-ba63-4ca3-8e90-1a86ac41919e None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:33.466580 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 66/135] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:26:33 2022] PUT /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28/users/764bfa213b604c20a8badf2dcbdd4fa7/roles/d7e1e74a1b2f48319ddb2eadb4ffa9a1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:26:33.468047 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9bf25-2bd1-483d-b8c3-2b81e46495d6 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:33.476848 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9bf25-2bd1-483d-b8c3-2b81e46495d6 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:33.476848 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9bf25-2bd1-483d-b8c3-2b81e46495d6 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:33.476848 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 67/136] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:33.476848 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9bf25-2bd1-483d-b8c3-2b81e46495d6 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:33.497741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:33.566963 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:33.631575 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9bf25-2bd1-483d-b8c3-2b81e46495d6 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:33.662853 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea3fbb-ba63-4ca3-8e90-1a86ac41919e None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:33.672829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352f9db-24ca-44ef-808c-5dcbd76a50eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:33.673465 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f9db-24ca-44ef-808c-5dcbd76a50eb None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:33.673749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f9db-24ca-44ef-808c-5dcbd76a50eb None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:33.674026 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f9db-24ca-44ef-808c-5dcbd76a50eb None admin] PATH_INFO: `/v3/projects/b5c0ceed4b9843fa909c39d6ed10a972/users/764bfa213b604c20a8badf2dcbdd4fa7/roles/f81ebe87e8a74c24a390dbaafdacdbce` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:33.676398 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352f9db-24ca-44ef-808c-5dcbd76a50eb None admin] RBAC: Authorizing `identity:create_grant(project_id=b5c0ceed4b9843fa909c39d6ed10a972, user_id=764bfa213b604c20a8badf2dcbdd4fa7, role_id=f81ebe87e8a74c24a390dbaafdacdbce)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:33.678642 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352f9db-24ca-44ef-808c-5dcbd76a50eb None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:33.706277 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394c7d-9e6b-4ec4-8af0-52be2454b597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:33.707024 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394c7d-9e6b-4ec4-8af0-52be2454b597 None admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:33.707376 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394c7d-9e6b-4ec4-8af0-52be2454b597 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:33.707719 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6394c7d-9e6b-4ec4-8af0-52be2454b597 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28/users/764bfa213b604c20a8badf2dcbdd4fa7/roles/f81ebe87e8a74c24a390dbaafdacdbce` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:33.709826 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6394c7d-9e6b-4ec4-8af0-52be2454b597 None admin] RBAC: Authorizing `identity:create_grant(project_id=1819a9eb8b794d41999ed4c6e858aa28, user_id=764bfa213b604c20a8badf2dcbdd4fa7, role_id=f81ebe87e8a74c24a390dbaafdacdbce)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:33.711355 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6394c7d-9e6b-4ec4-8af0-52be2454b597 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:33.752103 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 68/137] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:26:33 2022] PUT /identity/v3/projects/b5c0ceed4b9843fa909c39d6ed10a972/users/764bfa213b604c20a8badf2dcbdd4fa7/roles/f81ebe87e8a74c24a390dbaafdacdbce => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:26:33.753813 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae331-db51-4cc6-9c21-25f6d01c524c None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:33.754301 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae331-db51-4cc6-9c21-25f6d01c524c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:33.754852 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae331-db51-4cc6-9c21-25f6d01c524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:33.776143 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-2acae331-db51-4cc6-9c21-25f6d01c524c None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:33.778132 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-2acae331-db51-4cc6-9c21-25f6d01c524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:33.799287 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 70/138] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:26:33 2022] PUT /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28/users/764bfa213b604c20a8badf2dcbdd4fa7/roles/f81ebe87e8a74c24a390dbaafdacdbce => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:26:33.862953 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 69/139] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:34.250143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394c7d-9e6b-4ec4-8af0-52be2454b597 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:34.376631 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6394c7d-9e6b-4ec4-8af0-52be2454b597 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:34.386389 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:34.422832 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596d534-5ac0-47bc-b68b-da0fa26b13a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:34.424620 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596d534-5ac0-47bc-b68b-da0fa26b13a4 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:34.424620 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596d534-5ac0-47bc-b68b-da0fa26b13a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:34.424620 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596d534-5ac0-47bc-b68b-da0fa26b13a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:34.425591 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596d534-5ac0-47bc-b68b-da0fa26b13a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:34.427187 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596d534-5ac0-47bc-b68b-da0fa26b13a4 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:34.429001 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 71/140] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:34.436212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acae331-db51-4cc6-9c21-25f6d01c524c None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:34.473117 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:34.547191 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acae331-db51-4cc6-9c21-25f6d01c524c None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:34.591865 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb8c1a-3ca6-4cde-b299-9b27e7a81f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:34.592511 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb8c1a-3ca6-4cde-b299-9b27e7a81f4b None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:34.592818 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb8c1a-3ca6-4cde-b299-9b27e7a81f4b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:34.593096 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb8c1a-3ca6-4cde-b299-9b27e7a81f4b None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:34.593759 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb8c1a-3ca6-4cde-b299-9b27e7a81f4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:34.595263 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb8c1a-3ca6-4cde-b299-9b27e7a81f4b None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:34.722135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 70/141] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 19 17:26:34 2022] POST /identity/v3/users => generated 283 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:26:34.785000 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793d879-8a1b-4156-a01a-bd5f22745b47 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:34.785654 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793d879-8a1b-4156-a01a-bd5f22745b47 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:34.786132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793d879-8a1b-4156-a01a-bd5f22745b47 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:34.787728 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 72/142] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:34.808831 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aae732-6d06-40a2-9c68-4ea57e1892c4 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:34.808831 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aae732-6d06-40a2-9c68-4ea57e1892c4 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:34.808831 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aae732-6d06-40a2-9c68-4ea57e1892c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:34.848674 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-96aae732-6d06-40a2-9c68-4ea57e1892c4 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:34.849946 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-96aae732-6d06-40a2-9c68-4ea57e1892c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:35.062867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 71/143] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:35.759097 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793d879-8a1b-4156-a01a-bd5f22745b47 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:35.876867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793d879-8a1b-4156-a01a-bd5f22745b47 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:35.914133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833afea5-c082-4846-9a43-fa3f06415d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:35.914769 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833afea5-c082-4846-9a43-fa3f06415d66 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:35.915049 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833afea5-c082-4846-9a43-fa3f06415d66 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:35.915320 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833afea5-c082-4846-9a43-fa3f06415d66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:35.926293 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833afea5-c082-4846-9a43-fa3f06415d66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-833afea5-c082-4846-9a43-fa3f06415d66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:35.932132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:35.933019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:35.933772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:35.933772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:35.933772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:35.933772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:35.933772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:35.933772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:35.933772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:35.933772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:35.933772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:35.933772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:35.933772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:35.933772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:35.936086 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 73/144] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:35.941928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aae732-6d06-40a2-9c68-4ea57e1892c4 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:35.971590 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:36.055580 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aae732-6d06-40a2-9c68-4ea57e1892c4 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:36.097261 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b9ad6-5ad2-423c-b840-82a5ed49c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:36.097876 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b9ad6-5ad2-423c-b840-82a5ed49c6ec None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:36.098165 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b9ad6-5ad2-423c-b840-82a5ed49c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:36.098436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b9ad6-5ad2-423c-b840-82a5ed49c6ec None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:36.099103 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b9ad6-5ad2-423c-b840-82a5ed49c6ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:36.099409 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b9ad6-5ad2-423c-b840-82a5ed49c6ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:36.100810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b9ad6-5ad2-423c-b840-82a5ed49c6ec None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:36.112442 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 72/145] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:36.117742 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833afea5-c082-4846-9a43-fa3f06415d66 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:36.163169 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:36.233588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833afea5-c082-4846-9a43-fa3f06415d66 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:36.270803 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57189d-1e6f-41f0-9f9c-e1ad791af6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:36.271439 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57189d-1e6f-41f0-9f9c-e1ad791af6f0 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:36.271714 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57189d-1e6f-41f0-9f9c-e1ad791af6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:36.271985 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57189d-1e6f-41f0-9f9c-e1ad791af6f0 None admin] PATH_INFO: `/v3/users/69c4ff647e4b4cac85f3ac5894b344ab` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:36.273137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57189d-1e6f-41f0-9f9c-e1ad791af6f0 None admin] RBAC: Authorizing `identity:get_user(user_id=69c4ff647e4b4cac85f3ac5894b344ab)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:36.274576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57189d-1e6f-41f0-9f9c-e1ad791af6f0 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:36.276209 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 74/146] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:36 2022] GET /identity/v3/users/69c4ff647e4b4cac85f3ac5894b344ab => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:36.281728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b9ad6-5ad2-423c-b840-82a5ed49c6ec None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:36.386358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:36.403198 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b9ad6-5ad2-423c-b840-82a5ed49c6ec None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:36.453793 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ec5e-b5af-4dec-8fd3-fb42292b9c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:36.454441 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ec5e-b5af-4dec-8fd3-fb42292b9c69 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:36.454723 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ec5e-b5af-4dec-8fd3-fb42292b9c69 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:36.455001 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ec5e-b5af-4dec-8fd3-fb42292b9c69 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:36.456597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8ec5e-b5af-4dec-8fd3-fb42292b9c69 None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:36.459009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8ec5e-b5af-4dec-8fd3-fb42292b9c69 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:36.462006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 73/147] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:36 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:36.468768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57189d-1e6f-41f0-9f9c-e1ad791af6f0 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:36.591469 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57189d-1e6f-41f0-9f9c-e1ad791af6f0 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:36.593939 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:36.628127 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2580c78-e37d-46bf-840a-8542d98ec0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:36.628821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2580c78-e37d-46bf-840a-8542d98ec0fc None admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:36.629103 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2580c78-e37d-46bf-840a-8542d98ec0fc None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:36.629376 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2580c78-e37d-46bf-840a-8542d98ec0fc None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28/users/69c4ff647e4b4cac85f3ac5894b344ab/roles/783aa30fbf304861957e0d234b935acf` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:36.631300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2580c78-e37d-46bf-840a-8542d98ec0fc None admin] RBAC: Authorizing `identity:create_grant(project_id=1819a9eb8b794d41999ed4c6e858aa28, user_id=69c4ff647e4b4cac85f3ac5894b344ab, role_id=783aa30fbf304861957e0d234b935acf)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:36.632760 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2580c78-e37d-46bf-840a-8542d98ec0fc None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:36.699483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfac79-6f6c-460e-8970-56b5b25916cf None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:36.699797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfac79-6f6c-460e-8970-56b5b25916cf None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:36.700040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfac79-6f6c-460e-8970-56b5b25916cf None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:36.701475 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 74/148] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:36.708857 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6acbf7-34dc-4666-9929-2673c3537f74 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:36.709143 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6acbf7-34dc-4666-9929-2673c3537f74 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:36.709418 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6acbf7-34dc-4666-9929-2673c3537f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:36.722183 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 75/149] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:26:36 2022] PUT /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28/users/69c4ff647e4b4cac85f3ac5894b344ab/roles/783aa30fbf304861957e0d234b935acf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:26:36.733583 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-ec6acbf7-34dc-4666-9929-2673c3537f74 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:36.735329 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-ec6acbf7-34dc-4666-9929-2673c3537f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:36.822693 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 75/150] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:36.847764 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee71a5c-0cd7-486b-945c-d2ef1aca1971 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:36.848268 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee71a5c-0cd7-486b-945c-d2ef1aca1971 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:36.848339 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee71a5c-0cd7-486b-945c-d2ef1aca1971 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:36.849687 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 76/151] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:36.855723 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0afe0-6848-47d2-a7c9-a827e558737a None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:36.856375 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0afe0-6848-47d2-a7c9-a827e558737a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:36.856884 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0afe0-6848-47d2-a7c9-a827e558737a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:36.881250 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-f8e0afe0-6848-47d2-a7c9-a827e558737a None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:36.882893 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-f8e0afe0-6848-47d2-a7c9-a827e558737a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:36.974119 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 76/152] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:37.255894 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee71a5c-0cd7-486b-945c-d2ef1aca1971 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:37.323211 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0adffb-d3b4-41ec-b689-88add836502c None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:37.323868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0adffb-d3b4-41ec-b689-88add836502c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:37.324342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0adffb-d3b4-41ec-b689-88add836502c None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:37.326221 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 77/153] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:26:37.332020 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72fab6-5869-41be-8e76-7658b1257afe None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:37.332546 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72fab6-5869-41be-8e76-7658b1257afe None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:37.333092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72fab6-5869-41be-8e76-7658b1257afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:37.355733 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-8a72fab6-5869-41be-8e76-7658b1257afe None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:37.357449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-8a72fab6-5869-41be-8e76-7658b1257afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:37.371329 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:37.399274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee71a5c-0cd7-486b-945c-d2ef1aca1971 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:37.471454 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec847e41-0d8c-4f2e-927c-be340e862fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:37.472092 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec847e41-0d8c-4f2e-927c-be340e862fc9 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:37.472368 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec847e41-0d8c-4f2e-927c-be340e862fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:37.472639 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec847e41-0d8c-4f2e-927c-be340e862fc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:37.477747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 78/154] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:37.492803 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec847e41-0d8c-4f2e-927c-be340e862fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-ec847e41-0d8c-4f2e-927c-be340e862fc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:37.498372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:37.499214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:37.499955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 77/155] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:26:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:37.506734 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72fab6-5869-41be-8e76-7658b1257afe None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:37.624044 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72fab6-5869-41be-8e76-7658b1257afe None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:37.663779 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413e10-10db-45b5-8d8c-84d74ef864b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:37.664399 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413e10-10db-45b5-8d8c-84d74ef864b7 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:37.664682 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413e10-10db-45b5-8d8c-84d74ef864b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:37.665031 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413e10-10db-45b5-8d8c-84d74ef864b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:37.665652 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413e10-10db-45b5-8d8c-84d74ef864b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:37.666506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413e10-10db-45b5-8d8c-84d74ef864b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:37.667898 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413e10-10db-45b5-8d8c-84d74ef864b7 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:37.677174 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 79/156] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:26:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:37.683634 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec847e41-0d8c-4f2e-927c-be340e862fc9 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:37.711685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:37.792758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec847e41-0d8c-4f2e-927c-be340e862fc9 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:37.829762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413e10-10db-45b5-8d8c-84d74ef864b7 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:37.833801 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:37.841396 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005d73b-6e6a-419a-90e7-c1ef290addc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:37.842039 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d73b-6e6a-419a-90e7-c1ef290addc6 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:37.846826 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d73b-6e6a-419a-90e7-c1ef290addc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:37.846826 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d73b-6e6a-419a-90e7-c1ef290addc6 None admin] PATH_INFO: `/v3/users/764bfa213b604c20a8badf2dcbdd4fa7` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:37.846826 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005d73b-6e6a-419a-90e7-c1ef290addc6 None admin] RBAC: Authorizing `identity:get_user(user_id=764bfa213b604c20a8badf2dcbdd4fa7)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:37.848434 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005d73b-6e6a-419a-90e7-c1ef290addc6 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:37.854251 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 78/157] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:37 2022] GET /identity/v3/users/764bfa213b604c20a8badf2dcbdd4fa7 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:37.860047 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d67ba-4850-40e0-8c25-99f49537b002 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:37.860333 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d67ba-4850-40e0-8c25-99f49537b002 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:37.860611 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d67ba-4850-40e0-8c25-99f49537b002 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:37.862113 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 79/158] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:37.869886 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c087c-eea4-4e74-908c-a7edb61e5f5c None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:37.870266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c087c-eea4-4e74-908c-a7edb61e5f5c None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:37.870546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c087c-eea4-4e74-908c-a7edb61e5f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:37.907936 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-340c087c-eea4-4e74-908c-a7edb61e5f5c None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:37.909177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-340c087c-eea4-4e74-908c-a7edb61e5f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:37.999809 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413e10-10db-45b5-8d8c-84d74ef864b7 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:38.041716 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27302b8-6dcf-405d-9fd1-cd1dfdcca6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:38.042580 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27302b8-6dcf-405d-9fd1-cd1dfdcca6b5 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:38.042922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27302b8-6dcf-405d-9fd1-cd1dfdcca6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:38.043143 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27302b8-6dcf-405d-9fd1-cd1dfdcca6b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:38.055646 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27302b8-6dcf-405d-9fd1-cd1dfdcca6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:38.058586 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 80/159] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:38.059655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c087c-eea4-4e74-908c-a7edb61e5f5c None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-e27302b8-6dcf-405d-9fd1-cd1dfdcca6b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:38.061715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:38.062561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:38.063325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 80/160] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:26:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:38.071588 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27302b8-6dcf-405d-9fd1-cd1dfdcca6b5 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:38.109902 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:38.185742 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:38.229998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c087c-eea4-4e74-908c-a7edb61e5f5c None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:38.258120 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27302b8-6dcf-405d-9fd1-cd1dfdcca6b5 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:38.268733 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e38815-87c1-4f23-80a3-d4f32ba63b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:38.269351 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e38815-87c1-4f23-80a3-d4f32ba63b24 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:38.269631 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e38815-87c1-4f23-80a3-d4f32ba63b24 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:38.269905 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e38815-87c1-4f23-80a3-d4f32ba63b24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:38.318107 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e371b-45c5-441b-8214-48672e2fcaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:38.318639 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e371b-45c5-441b-8214-48672e2fcaa4 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:38.318919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e371b-45c5-441b-8214-48672e2fcaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:38.319193 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e371b-45c5-441b-8214-48672e2fcaa4 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:38.319856 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e371b-45c5-441b-8214-48672e2fcaa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:38.320192 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e371b-45c5-441b-8214-48672e2fcaa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:38.321575 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e371b-45c5-441b-8214-48672e2fcaa4 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:38.335149 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 81/161] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:38.335997 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e371b-45c5-441b-8214-48672e2fcaa4 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:38.374735 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e38815-87c1-4f23-80a3-d4f32ba63b24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:38.376559 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e38815-87c1-4f23-80a3-d4f32ba63b24 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:38.435740 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:38.563840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e371b-45c5-441b-8214-48672e2fcaa4 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:38.609245 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:38.611213 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 81/162] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:38.612208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e38815-87c1-4f23-80a3-d4f32ba63b24 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:38.626321 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c4104-0d0f-4df1-8d28-f8e72c7f95ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:38.632759 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c4104-0d0f-4df1-8d28-f8e72c7f95ba None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:38.632759 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c4104-0d0f-4df1-8d28-f8e72c7f95ba None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:38.632759 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c4104-0d0f-4df1-8d28-f8e72c7f95ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:38.642819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c4104-0d0f-4df1-8d28-f8e72c7f95ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-117c4104-0d0f-4df1-8d28-f8e72c7f95ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:38.647483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:38.648457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:38.649352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:38.649352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:38.649352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:38.649352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:38.649352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:38.649352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:38.649352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:38.649352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:38.649352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:38.649352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:38.649352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:38.649352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:38.653031 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 82/163] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:38.653870 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c4104-0d0f-4df1-8d28-f8e72c7f95ba None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:38.790153 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c4104-0d0f-4df1-8d28-f8e72c7f95ba None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:38.823528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e38815-87c1-4f23-80a3-d4f32ba63b24 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:38.838886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0389b2-6653-4a3c-b2c9-04aed86276c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:38.839770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0389b2-6653-4a3c-b2c9-04aed86276c3 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:38.840209 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0389b2-6653-4a3c-b2c9-04aed86276c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:38.840628 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0389b2-6653-4a3c-b2c9-04aed86276c3 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:38.841943 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0389b2-6653-4a3c-b2c9-04aed86276c3 None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:38.843517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0389b2-6653-4a3c-b2c9-04aed86276c3 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:38.849436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 83/164] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:38 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:38.850409 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0389b2-6653-4a3c-b2c9-04aed86276c3 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:38.858532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:38.903350 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304ba9e-b73d-42ef-a9fa-1fc081a2e980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:38.904306 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304ba9e-b73d-42ef-a9fa-1fc081a2e980 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:38.910205 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304ba9e-b73d-42ef-a9fa-1fc081a2e980 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:38.910773 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304ba9e-b73d-42ef-a9fa-1fc081a2e980 None admin] PATH_INFO: `/v3/users/4194ee18e96548d99ebb8f12d43b6b6f` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:38.912291 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304ba9e-b73d-42ef-a9fa-1fc081a2e980 None admin] RBAC: Authorizing `identity:get_user(user_id=4194ee18e96548d99ebb8f12d43b6b6f)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:38.913974 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304ba9e-b73d-42ef-a9fa-1fc081a2e980 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:38.915811 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 82/165] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:38 2022] GET /identity/v3/users/4194ee18e96548d99ebb8f12d43b6b6f => generated 247 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:38.919778 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304ba9e-b73d-42ef-a9fa-1fc081a2e980 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:38.959411 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:39.062258 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0389b2-6653-4a3c-b2c9-04aed86276c3 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:39.135317 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e8df4-1343-44a4-8284-9f4c6e22bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:39.135940 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e8df4-1343-44a4-8284-9f4c6e22bf22 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:39.136221 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e8df4-1343-44a4-8284-9f4c6e22bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:39.136489 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e8df4-1343-44a4-8284-9f4c6e22bf22 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:39.137183 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e8df4-1343-44a4-8284-9f4c6e22bf22 None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:39.137888 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e8df4-1343-44a4-8284-9f4c6e22bf22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:39.139298 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e8df4-1343-44a4-8284-9f4c6e22bf22 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:39.148809 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 84/166] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:39.149607 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e8df4-1343-44a4-8284-9f4c6e22bf22 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:39.190626 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304ba9e-b73d-42ef-a9fa-1fc081a2e980 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:39.249433 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd595d-9a17-40fe-a073-a3c498aa5d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:39.250078 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd595d-9a17-40fe-a073-a3c498aa5d3e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:39.250352 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd595d-9a17-40fe-a073-a3c498aa5d3e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:39.250620 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd595d-9a17-40fe-a073-a3c498aa5d3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:39.254553 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e8df4-1343-44a4-8284-9f4c6e22bf22 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:39.265790 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd595d-9a17-40fe-a073-a3c498aa5d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:39.278374 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-68cd595d-9a17-40fe-a073-a3c498aa5d3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:39.278672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:39.279507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:39.280325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 83/167] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:39.281070 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd595d-9a17-40fe-a073-a3c498aa5d3e None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:39.290254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d4146-8d4f-4a02-9ef8-4ed647e15948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:39.290896 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d4146-8d4f-4a02-9ef8-4ed647e15948 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:39.291177 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d4146-8d4f-4a02-9ef8-4ed647e15948 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:39.291447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d4146-8d4f-4a02-9ef8-4ed647e15948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:39.292170 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d4146-8d4f-4a02-9ef8-4ed647e15948 None admin] RBAC: Adding query filter params (role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1, scope.project.id=1819a9eb8b794d41999ed4c6e858aa28, user.id=764bfa213b604c20a8badf2dcbdd4fa7) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:39.292474 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d4146-8d4f-4a02-9ef8-4ed647e15948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:39.293950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d4146-8d4f-4a02-9ef8-4ed647e15948 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:39.300496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 85/168] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:39 2022] GET /identity/v3/role_assignments?user.id=764bfa213b604c20a8badf2dcbdd4fa7&scope.project.id=1819a9eb8b794d41999ed4c6e858aa28&role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:39.301312 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d4146-8d4f-4a02-9ef8-4ed647e15948 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:39.368278 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:39.413060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d4146-8d4f-4a02-9ef8-4ed647e15948 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:39.452325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cc903-5485-4014-8e23-dea4e798983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:39.453225 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cc903-5485-4014-8e23-dea4e798983d None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:39.453651 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cc903-5485-4014-8e23-dea4e798983d None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:39.454200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cc903-5485-4014-8e23-dea4e798983d None admin] PATH_INFO: `/v3/users/764bfa213b604c20a8badf2dcbdd4fa7` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:39.455583 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cc903-5485-4014-8e23-dea4e798983d None admin] RBAC: Authorizing `identity:get_user(user_id=764bfa213b604c20a8badf2dcbdd4fa7)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:39.457271 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cc903-5485-4014-8e23-dea4e798983d None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:39.459145 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 86/169] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:39 2022] GET /identity/v3/users/764bfa213b604c20a8badf2dcbdd4fa7 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:39.460346 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cc903-5485-4014-8e23-dea4e798983d None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:39.470482 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd595d-9a17-40fe-a073-a3c498aa5d3e None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:39.522020 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:39.538147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77880-d36e-40d4-ac25-892e9bfcac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:39.538823 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77880-d36e-40d4-ac25-892e9bfcac5f None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:39.539105 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77880-d36e-40d4-ac25-892e9bfcac5f None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:39.539381 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77880-d36e-40d4-ac25-892e9bfcac5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:39.657709 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b77880-d36e-40d4-ac25-892e9bfcac5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:39.659599 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b77880-d36e-40d4-ac25-892e9bfcac5f None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:39.676829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cc903-5485-4014-8e23-dea4e798983d None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:39.744834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761471d-53a0-4ad0-92da-e47c9f8febf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:39.744834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761471d-53a0-4ad0-92da-e47c9f8febf4 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:39.744834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761471d-53a0-4ad0-92da-e47c9f8febf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:39.744834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761471d-53a0-4ad0-92da-e47c9f8febf4 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:39.745202 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761471d-53a0-4ad0-92da-e47c9f8febf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:39.745202 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761471d-53a0-4ad0-92da-e47c9f8febf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:39.746285 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761471d-53a0-4ad0-92da-e47c9f8febf4 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:39.757546 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 87/170] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:39.758436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761471d-53a0-4ad0-92da-e47c9f8febf4 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:39.765730 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:39.854120 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 84/171] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:39.855296 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77880-d36e-40d4-ac25-892e9bfcac5f None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:39.956672 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761471d-53a0-4ad0-92da-e47c9f8febf4 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:39.979603 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:40.011181 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb264-e0cd-4ffb-b12c-7d64298642cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:40.011767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb264-e0cd-4ffb-b12c-7d64298642cf None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.012050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb264-e0cd-4ffb-b12c-7d64298642cf None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.012322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb264-e0cd-4ffb-b12c-7d64298642cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.090942 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77880-d36e-40d4-ac25-892e9bfcac5f None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:40.123906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb264-e0cd-4ffb-b12c-7d64298642cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:40.124665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb264-e0cd-4ffb-b12c-7d64298642cf None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:40.173728 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca86b00-3ab9-47a0-ba69-c0da3a074e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:40.174778 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca86b00-3ab9-47a0-ba69-c0da3a074e97 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.175280 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca86b00-3ab9-47a0-ba69-c0da3a074e97 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.175757 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca86b00-3ab9-47a0-ba69-c0da3a074e97 None admin] PATH_INFO: `/v3/users/764bfa213b604c20a8badf2dcbdd4fa7` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.177314 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca86b00-3ab9-47a0-ba69-c0da3a074e97 None admin] RBAC: Authorizing `identity:get_user(user_id=764bfa213b604c20a8badf2dcbdd4fa7)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:40.179882 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca86b00-3ab9-47a0-ba69-c0da3a074e97 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:40.186051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 85/172] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:39 2022] GET /identity/v3/users/764bfa213b604c20a8badf2dcbdd4fa7 => generated 275 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:40.187284 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca86b00-3ab9-47a0-ba69-c0da3a074e97 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:40.237090 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:40.309619 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 88/173] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:40.311415 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74298d-bb4b-4f36-a797-37ef1b13d366 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.313086 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74298d-bb4b-4f36-a797-37ef1b13d366 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.314252 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74298d-bb4b-4f36-a797-37ef1b13d366 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.318325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 89/174] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:40.319279 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74298d-bb4b-4f36-a797-37ef1b13d366 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:40.343544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:40.375713 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca86b00-3ab9-47a0-ba69-c0da3a074e97 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:40.414417 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a596a-fefb-4334-8d2b-08fbd88e07d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:40.415050 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a596a-fefb-4334-8d2b-08fbd88e07d6 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.415328 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a596a-fefb-4334-8d2b-08fbd88e07d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.416419 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a596a-fefb-4334-8d2b-08fbd88e07d6 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.417473 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a596a-fefb-4334-8d2b-08fbd88e07d6 None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:40.418944 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a596a-fefb-4334-8d2b-08fbd88e07d6 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:40.421187 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 86/175] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:40 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:40.426301 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a596a-fefb-4334-8d2b-08fbd88e07d6 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:40.467683 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74298d-bb4b-4f36-a797-37ef1b13d366 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:40.505461 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093626cb-e64b-4d9a-9f2a-cebe78a64348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:40.506084 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093626cb-e64b-4d9a-9f2a-cebe78a64348 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.506359 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093626cb-e64b-4d9a-9f2a-cebe78a64348 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.506625 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093626cb-e64b-4d9a-9f2a-cebe78a64348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.542880 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:40.564875 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a596a-fefb-4334-8d2b-08fbd88e07d6 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:40.599217 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093626cb-e64b-4d9a-9f2a-cebe78a64348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:40.602702 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093626cb-e64b-4d9a-9f2a-cebe78a64348 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:40.606660 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2366fb6-63b2-4210-8ad0-92413e8ee450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:40.607117 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2366fb6-63b2-4210-8ad0-92413e8ee450 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.607395 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2366fb6-63b2-4210-8ad0-92413e8ee450 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.607665 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2366fb6-63b2-4210-8ad0-92413e8ee450 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.608806 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2366fb6-63b2-4210-8ad0-92413e8ee450 None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:40.610256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2366fb6-63b2-4210-8ad0-92413e8ee450 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:40.612256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 87/176] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:40 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:40.613613 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0603c83-4b91-4c2b-83b4-0171798d7ef1 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.613896 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0603c83-4b91-4c2b-83b4-0171798d7ef1 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.614168 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0603c83-4b91-4c2b-83b4-0171798d7ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.617877 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:40.633898 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-c0603c83-4b91-4c2b-83b4-0171798d7ef1 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:40.635956 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-c0603c83-4b91-4c2b-83b4-0171798d7ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:40.710105 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 88/177] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:40.711592 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b579952-1838-4710-aeea-dd933db136f7 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.711877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b579952-1838-4710-aeea-dd933db136f7 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.712146 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b579952-1838-4710-aeea-dd933db136f7 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.714081 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 89/178] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:40.717501 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b579952-1838-4710-aeea-dd933db136f7 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:40.718777 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 90/179] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:40.724128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093626cb-e64b-4d9a-9f2a-cebe78a64348 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:40.805430 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:40.825010 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b579952-1838-4710-aeea-dd933db136f7 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:40.837124 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093626cb-e64b-4d9a-9f2a-cebe78a64348 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:40.850249 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:40.861830 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0affc-02bf-4abd-bcd3-ff339c24795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:40.862423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0affc-02bf-4abd-bcd3-ff339c24795d None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.862695 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0affc-02bf-4abd-bcd3-ff339c24795d None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.862956 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0affc-02bf-4abd-bcd3-ff339c24795d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.863801 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0affc-02bf-4abd-bcd3-ff339c24795d None admin] RBAC: Adding query filter params (role.id=17791940429e48ac98d4bd49aa53a88c, scope.project.id=1819a9eb8b794d41999ed4c6e858aa28, user.id=4194ee18e96548d99ebb8f12d43b6b6f) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:40.864097 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0affc-02bf-4abd-bcd3-ff339c24795d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:40.865548 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0affc-02bf-4abd-bcd3-ff339c24795d None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:40.881007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 90/180] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:40 2022] GET /identity/v3/role_assignments?user.id=4194ee18e96548d99ebb8f12d43b6b6f&scope.project.id=1819a9eb8b794d41999ed4c6e858aa28&role.id=17791940429e48ac98d4bd49aa53a88c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:40.881007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69039e-4616-41ea-a24d-989a5c736c42 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.881007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69039e-4616-41ea-a24d-989a5c736c42 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.881007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69039e-4616-41ea-a24d-989a5c736c42 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.881007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 91/181] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:40.881007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4250973-7a5d-43c0-9c24-a3b49d11ab04 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.881481 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4250973-7a5d-43c0-9c24-a3b49d11ab04 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.881481 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4250973-7a5d-43c0-9c24-a3b49d11ab04 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.882559 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 92/182] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:40.883507 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e09edf-5b87-4f1e-8076-f1f4065e94eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:40.883686 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163bdad-f9c3-400c-a6fd-23b02f4f9dd0 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.883931 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163bdad-f9c3-400c-a6fd-23b02f4f9dd0 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.884195 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163bdad-f9c3-400c-a6fd-23b02f4f9dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.884352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e09edf-5b87-4f1e-8076-f1f4065e94eb None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:40.885371 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e09edf-5b87-4f1e-8076-f1f4065e94eb None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:40.885785 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e09edf-5b87-4f1e-8076-f1f4065e94eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:40.887310 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e09edf-5b87-4f1e-8076-f1f4065e94eb None admin] RBAC: Adding query filter params (role.id=f81ebe87e8a74c24a390dbaafdacdbce, scope.project.id=1819a9eb8b794d41999ed4c6e858aa28, user.id=764bfa213b604c20a8badf2dcbdd4fa7) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:40.888052 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e09edf-5b87-4f1e-8076-f1f4065e94eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:40.891987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e09edf-5b87-4f1e-8076-f1f4065e94eb None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:40.897972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 91/183] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:40 2022] GET /identity/v3/role_assignments?user.id=764bfa213b604c20a8badf2dcbdd4fa7&scope.project.id=1819a9eb8b794d41999ed4c6e858aa28&role.id=f81ebe87e8a74c24a390dbaafdacdbce => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:40.898821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e09edf-5b87-4f1e-8076-f1f4065e94eb None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:40.906248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-d163bdad-f9c3-400c-a6fd-23b02f4f9dd0 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:40.907578 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-d163bdad-f9c3-400c-a6fd-23b02f4f9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:41.013690 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 93/184] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:41.015072 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b546d73-515a-4b65-afdc-1672d847a3fb None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:41.015367 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b546d73-515a-4b65-afdc-1672d847a3fb None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:41.015638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b546d73-515a-4b65-afdc-1672d847a3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:41.056847 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e09edf-5b87-4f1e-8076-f1f4065e94eb None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:41.069170 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-0b546d73-515a-4b65-afdc-1672d847a3fb None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:41.070600 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-0b546d73-515a-4b65-afdc-1672d847a3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:41.127469 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efca8b-df4e-42e9-a094-cda0888a692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:41.128046 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efca8b-df4e-42e9-a094-cda0888a692f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:41.128328 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efca8b-df4e-42e9-a094-cda0888a692f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:41.128606 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efca8b-df4e-42e9-a094-cda0888a692f None admin] PATH_INFO: `/v3/projects/b5c0ceed4b9843fa909c39d6ed10a972` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:41.130049 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efca8b-df4e-42e9-a094-cda0888a692f None admin] RBAC: Authorizing `identity:get_project(project_id=b5c0ceed4b9843fa909c39d6ed10a972)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:41.131783 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efca8b-df4e-42e9-a094-cda0888a692f None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:41.139690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 92/185] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:40 2022] GET /identity/v3/projects/b5c0ceed4b9843fa909c39d6ed10a972 => generated 312 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:41.139690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4274f44-1b2e-4609-8f19-4b829d57d8e4 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:41.139690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4274f44-1b2e-4609-8f19-4b829d57d8e4 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:41.139690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4274f44-1b2e-4609-8f19-4b829d57d8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:41.172333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-f4274f44-1b2e-4609-8f19-4b829d57d8e4 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:41.173581 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-f4274f44-1b2e-4609-8f19-4b829d57d8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:41.183177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 94/186] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:41.184558 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b546d73-515a-4b65-afdc-1672d847a3fb None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:41.195458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:41.235035 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:41.267103 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 93/187] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:41.268032 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4274f44-1b2e-4609-8f19-4b829d57d8e4 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:41.300853 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b546d73-515a-4b65-afdc-1672d847a3fb None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:41.340018 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca6459-f231-4aa7-b2d6-2014e9374591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:41.340654 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca6459-f231-4aa7-b2d6-2014e9374591 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:41.340972 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca6459-f231-4aa7-b2d6-2014e9374591 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:41.341243 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca6459-f231-4aa7-b2d6-2014e9374591 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:41.354512 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca6459-f231-4aa7-b2d6-2014e9374591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-e9ca6459-f231-4aa7-b2d6-2014e9374591 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:41.359471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:41.360307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:41.361129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 95/188] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:26:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:41.367216 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca6459-f231-4aa7-b2d6-2014e9374591 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:41.446359 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:41.482050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4274f44-1b2e-4609-8f19-4b829d57d8e4 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:41.483047 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca6459-f231-4aa7-b2d6-2014e9374591 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:41.524770 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fb598-afb8-492e-8fd8-ced653bcf558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:41.528171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fb598-afb8-492e-8fd8-ced653bcf558 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:41.528480 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fb598-afb8-492e-8fd8-ced653bcf558 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:41.528758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fb598-afb8-492e-8fd8-ced653bcf558 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:41.529730 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fb598-afb8-492e-8fd8-ced653bcf558 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:41.530039 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fb598-afb8-492e-8fd8-ced653bcf558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:41.531552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fb598-afb8-492e-8fd8-ced653bcf558 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:41.535973 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0cefc-b545-469a-b020-cbaa93f57294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:41.536965 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0cefc-b545-469a-b020-cbaa93f57294 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:41.537442 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0cefc-b545-469a-b020-cbaa93f57294 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:41.537906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0cefc-b545-469a-b020-cbaa93f57294 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:41.538861 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0cefc-b545-469a-b020-cbaa93f57294 None admin] RBAC: Adding query filter params (role.id=f81ebe87e8a74c24a390dbaafdacdbce, scope.project.id=b5c0ceed4b9843fa909c39d6ed10a972, user.id=764bfa213b604c20a8badf2dcbdd4fa7) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:41.539377 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0cefc-b545-469a-b020-cbaa93f57294 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:41.541639 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0cefc-b545-469a-b020-cbaa93f57294 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:41.542030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 96/189] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:41.542875 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fb598-afb8-492e-8fd8-ced653bcf558 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:41.551948 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 94/190] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:41 2022] GET /identity/v3/role_assignments?user.id=764bfa213b604c20a8badf2dcbdd4fa7&scope.project.id=b5c0ceed4b9843fa909c39d6ed10a972&role.id=f81ebe87e8a74c24a390dbaafdacdbce => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:41.553226 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0cefc-b545-469a-b020-cbaa93f57294 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:41.595048 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:41.676955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0cefc-b545-469a-b020-cbaa93f57294 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:41.693975 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fb598-afb8-492e-8fd8-ced653bcf558 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:41.714261 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6c8a1-5781-47c3-8f14-bcefed187d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:41.714912 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6c8a1-5781-47c3-8f14-bcefed187d51 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:41.715377 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6c8a1-5781-47c3-8f14-bcefed187d51 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:41.715798 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6c8a1-5781-47c3-8f14-bcefed187d51 None admin] PATH_INFO: `/v3/users/f27a8beb04cd43a2884f77e82c948d11` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:41.731870 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6c8a1-5781-47c3-8f14-bcefed187d51 None admin] RBAC: Authorizing `identity:get_user(user_id=f27a8beb04cd43a2884f77e82c948d11)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:41.733639 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6c8a1-5781-47c3-8f14-bcefed187d51 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:41.733989 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b3a4d-15d9-44a0-93ab-744855ea07a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:41.734635 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b3a4d-15d9-44a0-93ab-744855ea07a9 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:41.734915 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b3a4d-15d9-44a0-93ab-744855ea07a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:41.735191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b3a4d-15d9-44a0-93ab-744855ea07a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:41.736211 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 95/191] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:41 2022] GET /identity/v3/users/f27a8beb04cd43a2884f77e82c948d11 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:41.740768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b3a4d-15d9-44a0-93ab-744855ea07a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:41.740768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:41.741801 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b3a4d-15d9-44a0-93ab-744855ea07a9 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:41.742149 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6c8a1-5781-47c3-8f14-bcefed187d51 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:41.744277 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 97/192] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:41.745352 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b3a4d-15d9-44a0-93ab-744855ea07a9 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:41.851756 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:41.859666 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6c8a1-5781-47c3-8f14-bcefed187d51 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:41.862236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b3a4d-15d9-44a0-93ab-744855ea07a9 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:41.898726 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de215e08-b60f-4afe-8c7f-f9a84d696de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:41.899353 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de215e08-b60f-4afe-8c7f-f9a84d696de4 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:41.899633 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de215e08-b60f-4afe-8c7f-f9a84d696de4 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:41.899906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de215e08-b60f-4afe-8c7f-f9a84d696de4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:41.901268 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5207f3-0cc0-4ec3-a4cc-cb956e000774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:41.901862 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5207f3-0cc0-4ec3-a4cc-cb956e000774 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:41.902138 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5207f3-0cc0-4ec3-a4cc-cb956e000774 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:41.902402 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5207f3-0cc0-4ec3-a4cc-cb956e000774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:41.910554 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de215e08-b60f-4afe-8c7f-f9a84d696de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-de215e08-b60f-4afe-8c7f-f9a84d696de4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:41.915152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:41.916654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 96/193] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:26:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:41.922009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de215e08-b60f-4afe-8c7f-f9a84d696de4 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:41.970992 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:41.974585 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5207f3-0cc0-4ec3-a4cc-cb956e000774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:41.976063 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5207f3-0cc0-4ec3-a4cc-cb956e000774 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:42.027072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de215e08-b60f-4afe-8c7f-f9a84d696de4 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:42.061635 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b70c21-04e1-4c85-94ae-f13b2989cb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:42.062239 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b70c21-04e1-4c85-94ae-f13b2989cb94 None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:42.062512 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b70c21-04e1-4c85-94ae-f13b2989cb94 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:42.062788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b70c21-04e1-4c85-94ae-f13b2989cb94 None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:42.063421 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b70c21-04e1-4c85-94ae-f13b2989cb94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:42.064922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b70c21-04e1-4c85-94ae-f13b2989cb94 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:42.085698 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 98/194] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:42.086639 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5207f3-0cc0-4ec3-a4cc-cb956e000774 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:42.203220 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:42.206960 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5207f3-0cc0-4ec3-a4cc-cb956e000774 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:42.216275 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 97/195] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 19 17:26:41 2022] POST /identity/v3/users => generated 297 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:26:42.217415 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b70c21-04e1-4c85-94ae-f13b2989cb94 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:42.231780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:42.261399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dabba-33f8-40c6-ba3f-44621d89c37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:42.262188 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dabba-33f8-40c6-ba3f-44621d89c37a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:42.263812 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dabba-33f8-40c6-ba3f-44621d89c37a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:42.264119 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dabba-33f8-40c6-ba3f-44621d89c37a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:42.282687 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dabba-33f8-40c6-ba3f-44621d89c37a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-de4dabba-33f8-40c6-ba3f-44621d89c37a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:42.287805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:42.288838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:42.289602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 99/196] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:42.290274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dabba-33f8-40c6-ba3f-44621d89c37a None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:42.351354 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b70c21-04e1-4c85-94ae-f13b2989cb94 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:42.395370 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069f70a-f93e-4dd8-858c-59e7b0eaf76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:42.395999 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069f70a-f93e-4dd8-858c-59e7b0eaf76d None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:42.396273 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069f70a-f93e-4dd8-858c-59e7b0eaf76d None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:42.396547 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069f70a-f93e-4dd8-858c-59e7b0eaf76d None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:42.397261 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069f70a-f93e-4dd8-858c-59e7b0eaf76d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:42.397564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069f70a-f93e-4dd8-858c-59e7b0eaf76d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:42.398967 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069f70a-f93e-4dd8-858c-59e7b0eaf76d None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:42.412222 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 98/197] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:26:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:42.413097 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069f70a-f93e-4dd8-858c-59e7b0eaf76d None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:42.434595 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dabba-33f8-40c6-ba3f-44621d89c37a None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:42.476815 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c38bf-6cd2-4788-9282-3fa5129e3c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:42.477390 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c38bf-6cd2-4788-9282-3fa5129e3c0e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:42.477889 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c38bf-6cd2-4788-9282-3fa5129e3c0e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:42.478039 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c38bf-6cd2-4788-9282-3fa5129e3c0e None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:42.479260 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c38bf-6cd2-4788-9282-3fa5129e3c0e None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:42.480752 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c38bf-6cd2-4788-9282-3fa5129e3c0e None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:42.482444 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 100/198] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:42 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:42.483151 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c38bf-6cd2-4788-9282-3fa5129e3c0e None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:42.507667 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:42.518430 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:42.551170 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069f70a-f93e-4dd8-858c-59e7b0eaf76d None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:42.596140 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7ddf9-2343-4c63-be96-cee03f4d8432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:42.596776 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7ddf9-2343-4c63-be96-cee03f4d8432 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:42.597059 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7ddf9-2343-4c63-be96-cee03f4d8432 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:42.597329 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7ddf9-2343-4c63-be96-cee03f4d8432 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:42.599251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7ddf9-2343-4c63-be96-cee03f4d8432 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:42.599251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7ddf9-2343-4c63-be96-cee03f4d8432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:42.599662 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7ddf9-2343-4c63-be96-cee03f4d8432 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:42.608483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 99/199] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:42.609355 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7ddf9-2343-4c63-be96-cee03f4d8432 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:42.618139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c38bf-6cd2-4788-9282-3fa5129e3c0e None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:42.658786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c9c01-b46f-4a07-97a0-46b434cc1cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:42.659728 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9c01-b46f-4a07-97a0-46b434cc1cf0 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:42.660008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9c01-b46f-4a07-97a0-46b434cc1cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:42.660307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9c01-b46f-4a07-97a0-46b434cc1cf0 None admin] PATH_INFO: `/v3/users/f27a8beb04cd43a2884f77e82c948d11` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:42.661507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c9c01-b46f-4a07-97a0-46b434cc1cf0 None admin] RBAC: Authorizing `identity:get_user(user_id=f27a8beb04cd43a2884f77e82c948d11)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:42.662950 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c9c01-b46f-4a07-97a0-46b434cc1cf0 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:42.664526 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 101/200] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:42 2022] GET /identity/v3/users/f27a8beb04cd43a2884f77e82c948d11 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:42.665393 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c9c01-b46f-4a07-97a0-46b434cc1cf0 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:42.752243 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7ddf9-2343-4c63-be96-cee03f4d8432 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:42.796714 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:42.798977 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204a8a5-5f88-43a5-b91b-192a33980768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:42.799878 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204a8a5-5f88-43a5-b91b-192a33980768 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:42.800442 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204a8a5-5f88-43a5-b91b-192a33980768 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:42.800960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204a8a5-5f88-43a5-b91b-192a33980768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:42.801895 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204a8a5-5f88-43a5-b91b-192a33980768 None admin] RBAC: Adding query filter params (role.id=17791940429e48ac98d4bd49aa53a88c, scope.project.id=1eaaf654aca040a7bc85be7d785887be, user.id=f27a8beb04cd43a2884f77e82c948d11) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:42.802412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204a8a5-5f88-43a5-b91b-192a33980768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:42.803612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c9c01-b46f-4a07-97a0-46b434cc1cf0 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:42.815364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204a8a5-5f88-43a5-b91b-192a33980768 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:42.815364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:42.815364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 100/201] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:42 2022] GET /identity/v3/role_assignments?user.id=f27a8beb04cd43a2884f77e82c948d11&scope.project.id=1eaaf654aca040a7bc85be7d785887be&role.id=17791940429e48ac98d4bd49aa53a88c => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:42.815364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204a8a5-5f88-43a5-b91b-192a33980768 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:42.849392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783306d-a061-4121-b93f-9885330fbab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:42.851705 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783306d-a061-4121-b93f-9885330fbab9 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:42.851705 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783306d-a061-4121-b93f-9885330fbab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:42.851705 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783306d-a061-4121-b93f-9885330fbab9 None admin] PATH_INFO: `/v3/users/69c4ff647e4b4cac85f3ac5894b344ab` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:42.851990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783306d-a061-4121-b93f-9885330fbab9 None admin] RBAC: Authorizing `identity:get_user(user_id=69c4ff647e4b4cac85f3ac5894b344ab)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:42.854261 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783306d-a061-4121-b93f-9885330fbab9 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:42.856242 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 102/202] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:42 2022] GET /identity/v3/users/69c4ff647e4b4cac85f3ac5894b344ab => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:42.861751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783306d-a061-4121-b93f-9885330fbab9 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:42.952993 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204a8a5-5f88-43a5-b91b-192a33980768 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:42.980510 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783306d-a061-4121-b93f-9885330fbab9 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:43.005604 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cc6e3-adc0-49d5-87c1-43966df5515b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:43.006154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cc6e3-adc0-49d5-87c1-43966df5515b None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:43.006435 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cc6e3-adc0-49d5-87c1-43966df5515b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:43.006707 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cc6e3-adc0-49d5-87c1-43966df5515b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:43.019859 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799078ce-5861-41cf-9130-6625660f6947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:43.020625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799078ce-5861-41cf-9130-6625660f6947 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:43.021005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799078ce-5861-41cf-9130-6625660f6947 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:43.021358 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799078ce-5861-41cf-9130-6625660f6947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:43.057348 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:43.111564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:43.116054 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cc6e3-adc0-49d5-87c1-43966df5515b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:43.117575 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cc6e3-adc0-49d5-87c1-43966df5515b None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:43.133157 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799078ce-5861-41cf-9130-6625660f6947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:43.134673 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799078ce-5861-41cf-9130-6625660f6947 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:43.233673 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 101/203] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:43.241729 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cc6e3-adc0-49d5-87c1-43966df5515b None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:43.274678 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 103/204] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:43.280875 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799078ce-5861-41cf-9130-6625660f6947 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:43.385065 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:43.421360 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:43.432228 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cc6e3-adc0-49d5-87c1-43966df5515b None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:43.462786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b65b8-e134-4250-be2b-67990e612940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:43.463425 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b65b8-e134-4250-be2b-67990e612940 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:43.463703 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b65b8-e134-4250-be2b-67990e612940 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:43.463975 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b65b8-e134-4250-be2b-67990e612940 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:43.465173 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b65b8-e134-4250-be2b-67990e612940 None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:43.466795 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b65b8-e134-4250-be2b-67990e612940 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:43.468970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 102/205] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:43 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:43.474380 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b65b8-e134-4250-be2b-67990e612940 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:43.491872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799078ce-5861-41cf-9130-6625660f6947 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:43.601480 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e022a-2839-4b46-8882-c06c4b4aabd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:43.602047 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e022a-2839-4b46-8882-c06c4b4aabd1 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:43.602325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e022a-2839-4b46-8882-c06c4b4aabd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:43.602598 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e022a-2839-4b46-8882-c06c4b4aabd1 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:43.604394 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e022a-2839-4b46-8882-c06c4b4aabd1 None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:43.606175 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e022a-2839-4b46-8882-c06c4b4aabd1 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:43.608341 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 104/206] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:43 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:43.618310 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e022a-2839-4b46-8882-c06c4b4aabd1 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:43.623432 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b65b8-e134-4250-be2b-67990e612940 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:43.666853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f85680-1b81-40ae-a54b-9c7ff7aa3a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:43.667828 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f85680-1b81-40ae-a54b-9c7ff7aa3a50 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:43.668326 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f85680-1b81-40ae-a54b-9c7ff7aa3a50 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:43.668840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f85680-1b81-40ae-a54b-9c7ff7aa3a50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:43.669762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f85680-1b81-40ae-a54b-9c7ff7aa3a50 None admin] RBAC: Adding query filter params (role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1, scope.project.id=1eaaf654aca040a7bc85be7d785887be, user.id=f27a8beb04cd43a2884f77e82c948d11) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:43.670510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f85680-1b81-40ae-a54b-9c7ff7aa3a50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:43.672142 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f85680-1b81-40ae-a54b-9c7ff7aa3a50 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:43.681889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 103/207] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:43 2022] GET /identity/v3/role_assignments?user.id=f27a8beb04cd43a2884f77e82c948d11&scope.project.id=1eaaf654aca040a7bc85be7d785887be&role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:43.800969 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e022a-2839-4b46-8882-c06c4b4aabd1 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:43.854451 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:43.860269 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf2bf1-a02b-48f8-af90-17bb631cfbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:43.861000 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf2bf1-a02b-48f8-af90-17bb631cfbbf None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:43.861367 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf2bf1-a02b-48f8-af90-17bb631cfbbf None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:43.861644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf2bf1-a02b-48f8-af90-17bb631cfbbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:43.862385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf2bf1-a02b-48f8-af90-17bb631cfbbf None admin] RBAC: Adding query filter params (role.id=783aa30fbf304861957e0d234b935acf, scope.project.id=1819a9eb8b794d41999ed4c6e858aa28, user.id=69c4ff647e4b4cac85f3ac5894b344ab) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:43.862693 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf2bf1-a02b-48f8-af90-17bb631cfbbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:43.864177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf2bf1-a02b-48f8-af90-17bb631cfbbf None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:43.871481 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 105/208] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:43 2022] GET /identity/v3/role_assignments?user.id=69c4ff647e4b4cac85f3ac5894b344ab&scope.project.id=1819a9eb8b794d41999ed4c6e858aa28&role.id=783aa30fbf304861957e0d234b935acf => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:44.810408 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6bdb-6e24-471d-98f0-bcf2bcabc4c8 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:44.810897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6bdb-6e24-471d-98f0-bcf2bcabc4c8 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:44.810897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6bdb-6e24-471d-98f0-bcf2bcabc4c8 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:44.812171 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 104/209] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:44.817480 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f97b3-927d-4b89-ac78-1522c1408158 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:44.818270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f97b3-927d-4b89-ac78-1522c1408158 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:44.818736 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f97b3-927d-4b89-ac78-1522c1408158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:44.838230 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-0e2f97b3-927d-4b89-ac78-1522c1408158 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:44.839697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-0e2f97b3-927d-4b89-ac78-1522c1408158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:44.909848 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 106/210] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:44.941539 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd66b9-e49e-430e-a255-15e0ae70a8fe None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:44.941854 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd66b9-e49e-430e-a255-15e0ae70a8fe None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:44.942093 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd66b9-e49e-430e-a255-15e0ae70a8fe None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:44.943729 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 105/211] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:44.949504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06918e9-a03f-4b7b-a19f-1a70da51e9b6 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:44.950008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06918e9-a03f-4b7b-a19f-1a70da51e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:44.950474 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06918e9-a03f-4b7b-a19f-1a70da51e9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:44.969745 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-d06918e9-a03f-4b7b-a19f-1a70da51e9b6 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:44.970939 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-d06918e9-a03f-4b7b-a19f-1a70da51e9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:45.043393 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 107/212] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:45.235747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd66b9-e49e-430e-a255-15e0ae70a8fe None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:45.266701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:45.345555 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd66b9-e49e-430e-a255-15e0ae70a8fe None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:45.385213 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06918e9-a03f-4b7b-a19f-1a70da51e9b6 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:45.385442 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614807a7-1d63-4f9a-b22f-5ecf3700e41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:45.385933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614807a7-1d63-4f9a-b22f-5ecf3700e41b None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:45.386211 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614807a7-1d63-4f9a-b22f-5ecf3700e41b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:45.386479 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614807a7-1d63-4f9a-b22f-5ecf3700e41b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:45.397449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614807a7-1d63-4f9a-b22f-5ecf3700e41b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-614807a7-1d63-4f9a-b22f-5ecf3700e41b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:45.402413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:45.403269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:45.404060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 106/213] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:45.409274 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614807a7-1d63-4f9a-b22f-5ecf3700e41b None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:45.452707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:45.511684 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06918e9-a03f-4b7b-a19f-1a70da51e9b6 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:45.523154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:45.533709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614807a7-1d63-4f9a-b22f-5ecf3700e41b None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:45.548280 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f3ee1-df03-47d9-9029-1c62c89811af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:45.548940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f3ee1-df03-47d9-9029-1c62c89811af None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:45.549218 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f3ee1-df03-47d9-9029-1c62c89811af None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:45.549550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f3ee1-df03-47d9-9029-1c62c89811af None admin] PATH_INFO: `/v3/domains/default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:45.550664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f3ee1-df03-47d9-9029-1c62c89811af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:45.552167 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f3ee1-df03-47d9-9029-1c62c89811af None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:45.558045 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 108/214] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:45.558045 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464414a6-9340-4a97-a6d9-fb5ea2911c01 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:45.558045 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464414a6-9340-4a97-a6d9-fb5ea2911c01 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:45.558045 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464414a6-9340-4a97-a6d9-fb5ea2911c01 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:45.558045 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 109/215] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:45.559531 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464414a6-9340-4a97-a6d9-fb5ea2911c01 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:45.579747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813b6e-5c70-460c-a34b-7e45e880301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:45.580487 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813b6e-5c70-460c-a34b-7e45e880301c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:45.580667 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813b6e-5c70-460c-a34b-7e45e880301c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:45.580910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813b6e-5c70-460c-a34b-7e45e880301c None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:45.581573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813b6e-5c70-460c-a34b-7e45e880301c None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:45.581872 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813b6e-5c70-460c-a34b-7e45e880301c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:45.583250 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813b6e-5c70-460c-a34b-7e45e880301c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:45.592257 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 107/216] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:45.598358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c691-e211-4a3c-a532-afd418782280 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:45.598649 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c691-e211-4a3c-a532-afd418782280 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:45.598931 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c691-e211-4a3c-a532-afd418782280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:45.617702 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-28b3c691-e211-4a3c-a532-afd418782280 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:45.618977 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-28b3c691-e211-4a3c-a532-afd418782280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:45.685495 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464414a6-9340-4a97-a6d9-fb5ea2911c01 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:45.700794 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 108/217] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:45.700794 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c691-e211-4a3c-a532-afd418782280 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:45.717798 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:45.729940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fdebf-4f95-4dfc-b062-6a180271e8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:45.730558 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fdebf-4f95-4dfc-b062-6a180271e8b5 None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:45.730824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fdebf-4f95-4dfc-b062-6a180271e8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:45.731096 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fdebf-4f95-4dfc-b062-6a180271e8b5 None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:45.731731 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fdebf-4f95-4dfc-b062-6a180271e8b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:45.733209 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fdebf-4f95-4dfc-b062-6a180271e8b5 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:45.803870 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:45.823478 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c691-e211-4a3c-a532-afd418782280 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:45.855722 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 110/218] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 19 17:26:45 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:26:45.873102 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a4c99-5d49-49e7-a123-9b38339d6e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:45.874358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a4c99-5d49-49e7-a123-9b38339d6e1d None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:45.875035 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a4c99-5d49-49e7-a123-9b38339d6e1d None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:45.875932 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a4c99-5d49-49e7-a123-9b38339d6e1d None admin] PATH_INFO: `/v3/users/ce0a78f0e8854b7a9141a2520e355151` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:45.892105 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a4c99-5d49-49e7-a123-9b38339d6e1d None admin] RBAC: Authorizing `identity:get_user(user_id=ce0a78f0e8854b7a9141a2520e355151)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:45.893716 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a4c99-5d49-49e7-a123-9b38339d6e1d None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:45.900832 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 109/219] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:45 2022] GET /identity/v3/users/ce0a78f0e8854b7a9141a2520e355151 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:45.902272 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fdebf-4f95-4dfc-b062-6a180271e8b5 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:46.017257 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fdebf-4f95-4dfc-b062-6a180271e8b5 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:46.033182 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a4c99-5d49-49e7-a123-9b38339d6e1d None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:46.060473 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704551d-74d3-4c82-8f70-750075a81fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:46.061055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704551d-74d3-4c82-8f70-750075a81fe3 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:46.061336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704551d-74d3-4c82-8f70-750075a81fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:46.061609 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704551d-74d3-4c82-8f70-750075a81fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:46.114949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:46.139341 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704551d-74d3-4c82-8f70-750075a81fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:46.140885 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704551d-74d3-4c82-8f70-750075a81fe3 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:46.240176 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a4c99-5d49-49e7-a123-9b38339d6e1d None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:46.257704 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 111/220] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:46.260983 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bda5a5-7540-4931-83d9-b8e64906a200 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:46.261410 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bda5a5-7540-4931-83d9-b8e64906a200 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:46.261839 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bda5a5-7540-4931-83d9-b8e64906a200 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:46.263547 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 112/221] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:46.271670 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c7c87-61bf-49a8-a7dd-9765c317bb99 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:46.272320 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c7c87-61bf-49a8-a7dd-9765c317bb99 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:46.272592 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c7c87-61bf-49a8-a7dd-9765c317bb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:46.282715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602e98e-43d8-40b8-b1cc-2eee60389f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:46.283346 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602e98e-43d8-40b8-b1cc-2eee60389f98 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:46.283623 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602e98e-43d8-40b8-b1cc-2eee60389f98 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:46.283899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602e98e-43d8-40b8-b1cc-2eee60389f98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:46.291605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-0e8c7c87-61bf-49a8-a7dd-9765c317bb99 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:46.291769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:46.292845 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-0e8c7c87-61bf-49a8-a7dd-9765c317bb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:46.298059 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602e98e-43d8-40b8-b1cc-2eee60389f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-9602e98e-43d8-40b8-b1cc-2eee60389f98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:46.303092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:46.305690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:46.307212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:46.307212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:46.307212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:46.307212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:46.307212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:46.307212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:46.307212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:46.307212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:46.307212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:46.307212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:46.307212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:46.307212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:46.308245 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 110/222] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:26:46.309213 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602e98e-43d8-40b8-b1cc-2eee60389f98 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:46.384014 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 113/223] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:46.385476 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c7c87-61bf-49a8-a7dd-9765c317bb99 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:46.396020 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:46.444924 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602e98e-43d8-40b8-b1cc-2eee60389f98 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:46.484499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a7cb6-39ef-4dfc-8740-6a813fe6c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:46.485318 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a7cb6-39ef-4dfc-8740-6a813fe6c57e None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:46.485681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a7cb6-39ef-4dfc-8740-6a813fe6c57e None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:46.486054 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a7cb6-39ef-4dfc-8740-6a813fe6c57e None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:46.487374 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a7cb6-39ef-4dfc-8740-6a813fe6c57e None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:46.489088 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a7cb6-39ef-4dfc-8740-6a813fe6c57e None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:46.491279 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 111/224] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:46 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:46.497089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a7cb6-39ef-4dfc-8740-6a813fe6c57e None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:46.516584 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c7c87-61bf-49a8-a7dd-9765c317bb99 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:46.561055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79622e17-d840-42b6-801b-06aea2ef57e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:46.564107 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79622e17-d840-42b6-801b-06aea2ef57e0 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:46.564391 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79622e17-d840-42b6-801b-06aea2ef57e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:46.564660 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79622e17-d840-42b6-801b-06aea2ef57e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:46.565357 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79622e17-d840-42b6-801b-06aea2ef57e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:46.565658 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79622e17-d840-42b6-801b-06aea2ef57e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:46.567038 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79622e17-d840-42b6-801b-06aea2ef57e0 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:46.577613 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 114/225] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:46.583000 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79622e17-d840-42b6-801b-06aea2ef57e0 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:46.630599 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:46.694440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a7cb6-39ef-4dfc-8740-6a813fe6c57e None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:46.715334 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:46.760966 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79622e17-d840-42b6-801b-06aea2ef57e0 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:46.770130 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c2b97-d27f-45f2-a298-0280d01279d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:46.771130 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c2b97-d27f-45f2-a298-0280d01279d7 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:46.771411 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c2b97-d27f-45f2-a298-0280d01279d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:46.771681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c2b97-d27f-45f2-a298-0280d01279d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:46.773028 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c2b97-d27f-45f2-a298-0280d01279d7 None admin] RBAC: Adding query filter params (role.id=f81ebe87e8a74c24a390dbaafdacdbce, scope.project.id=1eaaf654aca040a7bc85be7d785887be, user.id=ce0a78f0e8854b7a9141a2520e355151) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:46.773344 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c2b97-d27f-45f2-a298-0280d01279d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:46.775035 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c2b97-d27f-45f2-a298-0280d01279d7 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:46.793576 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 112/226] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:46 2022] GET /identity/v3/role_assignments?user.id=ce0a78f0e8854b7a9141a2520e355151&scope.project.id=1eaaf654aca040a7bc85be7d785887be&role.id=f81ebe87e8a74c24a390dbaafdacdbce => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:46.799133 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c2b97-d27f-45f2-a298-0280d01279d7 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:46.826018 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d43ae-64aa-46e2-98f0-53e45df12299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:46.836088 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d43ae-64aa-46e2-98f0-53e45df12299 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:46.836088 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d43ae-64aa-46e2-98f0-53e45df12299 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:46.836088 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d43ae-64aa-46e2-98f0-53e45df12299 None admin] PATH_INFO: `/v3/users/f27a8beb04cd43a2884f77e82c948d11` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:46.836088 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d43ae-64aa-46e2-98f0-53e45df12299 None admin] RBAC: Authorizing `identity:get_user(user_id=f27a8beb04cd43a2884f77e82c948d11)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:46.836088 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d43ae-64aa-46e2-98f0-53e45df12299 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:46.840201 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 115/227] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:46 2022] GET /identity/v3/users/f27a8beb04cd43a2884f77e82c948d11 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:46.841622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d43ae-64aa-46e2-98f0-53e45df12299 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:47.001330 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c2b97-d27f-45f2-a298-0280d01279d7 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:47.025582 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d43ae-64aa-46e2-98f0-53e45df12299 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:47.065098 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:47.072616 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b810c-910c-4fff-99fe-fbde7bdfd6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:47.073285 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b810c-910c-4fff-99fe-fbde7bdfd6d4 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:47.073568 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b810c-910c-4fff-99fe-fbde7bdfd6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:47.089622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b810c-910c-4fff-99fe-fbde7bdfd6d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:47.094025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eb26d-1a48-402f-974b-e3198ff9fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:47.094727 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eb26d-1a48-402f-974b-e3198ff9fa04 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:47.095011 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eb26d-1a48-402f-974b-e3198ff9fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:47.095286 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eb26d-1a48-402f-974b-e3198ff9fa04 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:47.096291 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b810c-910c-4fff-99fe-fbde7bdfd6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-e81b810c-910c-4fff-99fe-fbde7bdfd6d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:47.101043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:47.101899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:47.102680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 113/228] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:26:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:26:47.108012 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2eb26d-1a48-402f-974b-e3198ff9fa04 None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:47.109560 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2eb26d-1a48-402f-974b-e3198ff9fa04 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:47.111246 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 116/229] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:46 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:47.117280 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b810c-910c-4fff-99fe-fbde7bdfd6d4 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:47.118318 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eb26d-1a48-402f-974b-e3198ff9fa04 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:47.133077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:47.304073 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eb26d-1a48-402f-974b-e3198ff9fa04 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:47.307549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b810c-910c-4fff-99fe-fbde7bdfd6d4 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:47.347806 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855581bf-d506-4800-be95-459fa619ac84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:47.348553 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855581bf-d506-4800-be95-459fa619ac84 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:47.348886 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855581bf-d506-4800-be95-459fa619ac84 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:47.349236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855581bf-d506-4800-be95-459fa619ac84 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:47.350042 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855581bf-d506-4800-be95-459fa619ac84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:47.350351 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855581bf-d506-4800-be95-459fa619ac84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:47.351857 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855581bf-d506-4800-be95-459fa619ac84 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:47.369700 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 117/230] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:26:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:47.371625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855581bf-d506-4800-be95-459fa619ac84 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:47.374288 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff98935-a753-4b54-80ee-14ee80958b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:47.374965 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff98935-a753-4b54-80ee-14ee80958b2c None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:47.375246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff98935-a753-4b54-80ee-14ee80958b2c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:47.375523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff98935-a753-4b54-80ee-14ee80958b2c None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be/users/f27a8beb04cd43a2884f77e82c948d11/roles/17791940429e48ac98d4bd49aa53a88c` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:47.379997 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff98935-a753-4b54-80ee-14ee80958b2c None admin] RBAC: Authorizing `identity:create_grant(project_id=1eaaf654aca040a7bc85be7d785887be, user_id=f27a8beb04cd43a2884f77e82c948d11, role_id=17791940429e48ac98d4bd49aa53a88c)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:47.381487 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff98935-a753-4b54-80ee-14ee80958b2c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:47.463930 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:47.484290 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 114/231] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:26:47 2022] PUT /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be/users/f27a8beb04cd43a2884f77e82c948d11/roles/17791940429e48ac98d4bd49aa53a88c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:26:47.516752 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855581bf-d506-4800-be95-459fa619ac84 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:47.573222 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf15a0f-eadf-4f77-bf6a-20244d4f5357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:47.573780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf15a0f-eadf-4f77-bf6a-20244d4f5357 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:47.574063 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf15a0f-eadf-4f77-bf6a-20244d4f5357 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:47.574337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf15a0f-eadf-4f77-bf6a-20244d4f5357 None admin] PATH_INFO: `/v3/users/f27a8beb04cd43a2884f77e82c948d11` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:47.575486 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf15a0f-eadf-4f77-bf6a-20244d4f5357 None admin] RBAC: Authorizing `identity:get_user(user_id=f27a8beb04cd43a2884f77e82c948d11)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:47.576976 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf15a0f-eadf-4f77-bf6a-20244d4f5357 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:47.579884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 118/232] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:47 2022] GET /identity/v3/users/f27a8beb04cd43a2884f77e82c948d11 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:47.584531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff98935-a753-4b54-80ee-14ee80958b2c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:47.654008 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:47.720775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff98935-a753-4b54-80ee-14ee80958b2c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:47.770005 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735ba16-4085-4a82-b875-b2756a4ce23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:47.770700 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ba16-4085-4a82-b875-b2756a4ce23a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:47.770987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ba16-4085-4a82-b875-b2756a4ce23a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:47.771263 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735ba16-4085-4a82-b875-b2756a4ce23a None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:47.777797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735ba16-4085-4a82-b875-b2756a4ce23a None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:47.779292 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735ba16-4085-4a82-b875-b2756a4ce23a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:47.781408 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 115/233] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:47 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:47.787351 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf15a0f-eadf-4f77-bf6a-20244d4f5357 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:47.902829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf15a0f-eadf-4f77-bf6a-20244d4f5357 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:47.938160 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0ba29-a833-41e3-8ab2-9729275f7820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:47.946141 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0ba29-a833-41e3-8ab2-9729275f7820 None admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:47.946141 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0ba29-a833-41e3-8ab2-9729275f7820 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:47.946141 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0ba29-a833-41e3-8ab2-9729275f7820 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be/users/f27a8beb04cd43a2884f77e82c948d11/roles/d7e1e74a1b2f48319ddb2eadb4ffa9a1` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:47.946141 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0ba29-a833-41e3-8ab2-9729275f7820 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eaaf654aca040a7bc85be7d785887be, user_id=f27a8beb04cd43a2884f77e82c948d11, role_id=d7e1e74a1b2f48319ddb2eadb4ffa9a1)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:47.946141 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0ba29-a833-41e3-8ab2-9729275f7820 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:47.948371 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:48.105666 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 119/234] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:26:47 2022] PUT /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be/users/f27a8beb04cd43a2884f77e82c948d11/roles/d7e1e74a1b2f48319ddb2eadb4ffa9a1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:26:48.487605 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eca53-0728-49f4-a361-8c8914671e1f None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:48.488125 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eca53-0728-49f4-a361-8c8914671e1f None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:48.488125 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eca53-0728-49f4-a361-8c8914671e1f None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:48.489749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 116/235] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:48.494996 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f0bae-0356-47bc-9f74-de2e18ed511b None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:48.495283 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f0bae-0356-47bc-9f74-de2e18ed511b None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:48.495557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f0bae-0356-47bc-9f74-de2e18ed511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:48.522128 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-2b9f0bae-0356-47bc-9f74-de2e18ed511b None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:48.523305 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-2b9f0bae-0356-47bc-9f74-de2e18ed511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:48.609020 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 120/236] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:48.949535 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eca53-0728-49f4-a361-8c8914671e1f None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:49.006959 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e098e69-1335-4ff2-80d9-facecfc67aa5 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:49.007582 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e098e69-1335-4ff2-80d9-facecfc67aa5 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:49.008075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e098e69-1335-4ff2-80d9-facecfc67aa5 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:49.010556 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 121/237] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:49.016610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb91319-8bdd-44cf-8ae7-287a9de2da54 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:49.017324 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb91319-8bdd-44cf-8ae7-287a9de2da54 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:49.017793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb91319-8bdd-44cf-8ae7-287a9de2da54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:49.047661 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-8eb91319-8bdd-44cf-8ae7-287a9de2da54 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:49.048535 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-8eb91319-8bdd-44cf-8ae7-287a9de2da54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:49.076971 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eca53-0728-49f4-a361-8c8914671e1f None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:49.109126 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:49.118214 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954fa97-e438-4020-8799-40e295d1c806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:49.118890 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954fa97-e438-4020-8799-40e295d1c806 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:49.119168 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954fa97-e438-4020-8799-40e295d1c806 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:49.119440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954fa97-e438-4020-8799-40e295d1c806 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:49.140416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954fa97-e438-4020-8799-40e295d1c806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-7954fa97-e438-4020-8799-40e295d1c806 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:49.152922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:49.153821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:49.154597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:49.154597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:49.154597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:49.154597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:49.154597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:49.154597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:49.154597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:49.154597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:49.154597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:49.154597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:49.154597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:49.154597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:49.157445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 117/238] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:49.163479 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954fa97-e438-4020-8799-40e295d1c806 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:49.239913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 122/239] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:49.303901 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954fa97-e438-4020-8799-40e295d1c806 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:49.352372 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf269-4e46-4441-a15f-a389d52d0327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:49.352571 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07becc43-cffa-4776-b66f-8182f22e7cf9 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:49.352870 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07becc43-cffa-4776-b66f-8182f22e7cf9 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:49.353053 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf269-4e46-4441-a15f-a389d52d0327 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:49.353782 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07becc43-cffa-4776-b66f-8182f22e7cf9 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:49.353869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf269-4e46-4441-a15f-a389d52d0327 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:49.354117 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf269-4e46-4441-a15f-a389d52d0327 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:49.354779 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf269-4e46-4441-a15f-a389d52d0327 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:49.355049 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 123/240] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:49.355314 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf269-4e46-4441-a15f-a389d52d0327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:49.356700 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf269-4e46-4441-a15f-a389d52d0327 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:49.365952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448a8b3-6131-4586-bb8f-4b09e711db9d None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:49.366239 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448a8b3-6131-4586-bb8f-4b09e711db9d None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:49.366521 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448a8b3-6131-4586-bb8f-4b09e711db9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:49.369721 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 118/241] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:49.375280 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf269-4e46-4441-a15f-a389d52d0327 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:49.398857 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-3448a8b3-6131-4586-bb8f-4b09e711db9d None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:49.400628 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-3448a8b3-6131-4586-bb8f-4b09e711db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:49.466017 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:49.485137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 124/242] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:49.502881 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:49.592375 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf269-4e46-4441-a15f-a389d52d0327 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:49.638110 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49d623-c025-4467-aaef-19001f8d5a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:49.638743 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49d623-c025-4467-aaef-19001f8d5a60 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:49.639042 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49d623-c025-4467-aaef-19001f8d5a60 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:49.639311 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49d623-c025-4467-aaef-19001f8d5a60 None admin] PATH_INFO: `/v3/users/7047fd76856d489c96a1108e9f5858f0` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:49.660448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49d623-c025-4467-aaef-19001f8d5a60 None admin] RBAC: Authorizing `identity:get_user(user_id=7047fd76856d489c96a1108e9f5858f0)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:49.661934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49d623-c025-4467-aaef-19001f8d5a60 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:49.663780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 119/243] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:49 2022] GET /identity/v3/users/7047fd76856d489c96a1108e9f5858f0 => generated 297 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:49.670028 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448a8b3-6131-4586-bb8f-4b09e711db9d None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:49.679161 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49d623-c025-4467-aaef-19001f8d5a60 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:49.867936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:49.871768 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49d623-c025-4467-aaef-19001f8d5a60 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:49.878338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448a8b3-6131-4586-bb8f-4b09e711db9d None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:49.909977 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ecf2a-af1a-4992-b5a9-1da7ea08066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:49.910619 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ecf2a-af1a-4992-b5a9-1da7ea08066c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:49.910907 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ecf2a-af1a-4992-b5a9-1da7ea08066c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:49.911187 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ecf2a-af1a-4992-b5a9-1da7ea08066c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:49.913239 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ecf2a-af1a-4992-b5a9-1da7ea08066c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:49.917611 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ecf2a-af1a-4992-b5a9-1da7ea08066c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:49.919215 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 120/244] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:49.927078 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ecf2a-af1a-4992-b5a9-1da7ea08066c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:49.952701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e79a3d-c7d0-4c99-b345-4122847a539f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:49.953331 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e79a3d-c7d0-4c99-b345-4122847a539f None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:49.953612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e79a3d-c7d0-4c99-b345-4122847a539f None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:49.953886 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e79a3d-c7d0-4c99-b345-4122847a539f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:50.016947 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:50.031405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e79a3d-c7d0-4c99-b345-4122847a539f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:50.033338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e79a3d-c7d0-4c99-b345-4122847a539f None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:50.042843 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ecf2a-af1a-4992-b5a9-1da7ea08066c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:50.078778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf6595-09e2-445a-87fa-e913aa0ffcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:50.079395 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf6595-09e2-445a-87fa-e913aa0ffcd6 None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:50.079675 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf6595-09e2-445a-87fa-e913aa0ffcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:50.079950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf6595-09e2-445a-87fa-e913aa0ffcd6 None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:50.080919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf6595-09e2-445a-87fa-e913aa0ffcd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:50.082128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf6595-09e2-445a-87fa-e913aa0ffcd6 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:50.145170 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 125/245] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:50.150356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e79a3d-c7d0-4c99-b345-4122847a539f None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:50.186036 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 121/246] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 19 17:26:49 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:26:50.190079 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf6595-09e2-445a-87fa-e913aa0ffcd6 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:50.265303 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:50.348517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:50.371827 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e79a3d-c7d0-4c99-b345-4122847a539f None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:50.373111 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf6595-09e2-445a-87fa-e913aa0ffcd6 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:50.413684 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de59db5-7395-4ab1-8d4e-a348678c1539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:50.414496 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59db5-7395-4ab1-8d4e-a348678c1539 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:50.414781 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59db5-7395-4ab1-8d4e-a348678c1539 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:50.415057 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59db5-7395-4ab1-8d4e-a348678c1539 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:50.426672 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38799ac-000a-4303-b44b-85cda240a7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:50.427316 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38799ac-000a-4303-b44b-85cda240a7e2 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:50.427632 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38799ac-000a-4303-b44b-85cda240a7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:50.429086 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38799ac-000a-4303-b44b-85cda240a7e2 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:50.429706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de59db5-7395-4ab1-8d4e-a348678c1539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:50.430217 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38799ac-000a-4303-b44b-85cda240a7e2 None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:50.432259 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38799ac-000a-4303-b44b-85cda240a7e2 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:50.434360 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 122/247] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:50 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-5de59db5-7395-4ab1-8d4e-a348678c1539 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:50.435298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:50.436126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:50.436951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:50.436951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:50.436951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:50.436951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:50.436951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:50.436951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:50.436951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:50.436951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:50.436951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:50.436951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:50.436951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:50.436951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:50.437532 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a1c70-385e-4c64-951f-3ff20a4894f7 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:50.437532 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a1c70-385e-4c64-951f-3ff20a4894f7 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:50.437532 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a1c70-385e-4c64-951f-3ff20a4894f7 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:50.437706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 126/248] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:50.437777 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 123/249] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:50.443350 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a1c70-385e-4c64-951f-3ff20a4894f7 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:50.443607 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678521-098f-417b-9dd2-a19ec9e7461c None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:50.443894 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678521-098f-417b-9dd2-a19ec9e7461c None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:50.444177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678521-098f-417b-9dd2-a19ec9e7461c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:50.463433 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-3d678521-098f-417b-9dd2-a19ec9e7461c None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:50.464809 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-3d678521-098f-417b-9dd2-a19ec9e7461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:50.553558 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 127/250] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:50.554962 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d678521-098f-417b-9dd2-a19ec9e7461c None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:50.572033 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:50.586357 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a1c70-385e-4c64-951f-3ff20a4894f7 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:50.637229 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bb58a-077e-4693-adbf-8d79b8428c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:50.637838 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bb58a-077e-4693-adbf-8d79b8428c04 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:50.638279 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bb58a-077e-4693-adbf-8d79b8428c04 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:50.638547 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bb58a-077e-4693-adbf-8d79b8428c04 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:50.639572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bb58a-077e-4693-adbf-8d79b8428c04 None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:50.639871 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bb58a-077e-4693-adbf-8d79b8428c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:50.641276 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bb58a-077e-4693-adbf-8d79b8428c04 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:50.652460 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 124/251] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:50.658349 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bb58a-077e-4693-adbf-8d79b8428c04 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:50.669167 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:50.693725 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d678521-098f-417b-9dd2-a19ec9e7461c None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:50.734939 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c4a56-b397-4293-85b0-2408c39cdaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:50.735655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c4a56-b397-4293-85b0-2408c39cdaeb None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:50.736026 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c4a56-b397-4293-85b0-2408c39cdaeb None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:50.736360 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c4a56-b397-4293-85b0-2408c39cdaeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:50.737121 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c4a56-b397-4293-85b0-2408c39cdaeb None admin] RBAC: Adding query filter params (role.id=783aa30fbf304861957e0d234b935acf, scope.project.id=1eaaf654aca040a7bc85be7d785887be, user.id=7047fd76856d489c96a1108e9f5858f0) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:50.737482 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c4a56-b397-4293-85b0-2408c39cdaeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:50.739172 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c4a56-b397-4293-85b0-2408c39cdaeb None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:50.745691 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 128/252] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:50 2022] GET /identity/v3/role_assignments?user.id=7047fd76856d489c96a1108e9f5858f0&scope.project.id=1eaaf654aca040a7bc85be7d785887be&role.id=783aa30fbf304861957e0d234b935acf => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:50.787471 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bb58a-077e-4693-adbf-8d79b8428c04 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:50.831221 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b18241-331f-4597-9de6-205e4ea66765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:50.831869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b18241-331f-4597-9de6-205e4ea66765 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:50.832146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b18241-331f-4597-9de6-205e4ea66765 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:50.832416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b18241-331f-4597-9de6-205e4ea66765 None admin] PATH_INFO: `/v3/users/ce0a78f0e8854b7a9141a2520e355151` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:50.833620 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b18241-331f-4597-9de6-205e4ea66765 None admin] RBAC: Authorizing `identity:get_user(user_id=ce0a78f0e8854b7a9141a2520e355151)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:50.835349 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b18241-331f-4597-9de6-205e4ea66765 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:50.837379 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 125/253] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:50 2022] GET /identity/v3/users/ce0a78f0e8854b7a9141a2520e355151 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:50.839189 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e567b-438e-460d-8ecc-82190d835a99 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:50.839489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e567b-438e-460d-8ecc-82190d835a99 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:50.839843 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e567b-438e-460d-8ecc-82190d835a99 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:50.841366 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 129/254] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:50.846995 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6866242-906c-4f85-9d99-799d4421b3c7 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:50.847282 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6866242-906c-4f85-9d99-799d4421b3c7 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:50.847472 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e567b-438e-460d-8ecc-82190d835a99 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:50.847570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6866242-906c-4f85-9d99-799d4421b3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:50.874268 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-c6866242-906c-4f85-9d99-799d4421b3c7 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:50.875467 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-c6866242-906c-4f85-9d99-799d4421b3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:50.911733 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:50.998482 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 126/255] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:51.059771 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e567b-438e-460d-8ecc-82190d835a99 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:51.069298 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6866242-906c-4f85-9d99-799d4421b3c7 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:51.135643 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b28d-7496-4381-9ea7-bbc05495c49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:51.136271 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b28d-7496-4381-9ea7-bbc05495c49e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:51.136545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b28d-7496-4381-9ea7-bbc05495c49e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:51.136834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b28d-7496-4381-9ea7-bbc05495c49e None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:51.137982 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5b28d-7496-4381-9ea7-bbc05495c49e None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:51.139431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5b28d-7496-4381-9ea7-bbc05495c49e None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:51.141448 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 130/256] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:50 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:51.147117 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b28d-7496-4381-9ea7-bbc05495c49e None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:51.171261 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:51.214729 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6866242-906c-4f85-9d99-799d4421b3c7 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:51.250774 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5809d7d-a56b-47e0-ad72-90531794c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:51.251551 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5809d7d-a56b-47e0-ad72-90531794c693 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:51.251832 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5809d7d-a56b-47e0-ad72-90531794c693 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:51.252152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5809d7d-a56b-47e0-ad72-90531794c693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:51.264034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5809d7d-a56b-47e0-ad72-90531794c693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-b5809d7d-a56b-47e0-ad72-90531794c693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:51.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:51.269750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:51.270531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 127/257] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:26:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:26:51.276396 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5809d7d-a56b-47e0-ad72-90531794c693 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:51.293118 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:51.350189 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b28d-7496-4381-9ea7-bbc05495c49e None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:51.382394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5809d7d-a56b-47e0-ad72-90531794c693 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:51.420965 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dbb0d-46f2-4a2a-a5e1-f60afceb5413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:51.421586 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dbb0d-46f2-4a2a-a5e1-f60afceb5413 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:51.421869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dbb0d-46f2-4a2a-a5e1-f60afceb5413 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:51.422148 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dbb0d-46f2-4a2a-a5e1-f60afceb5413 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:51.422821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dbb0d-46f2-4a2a-a5e1-f60afceb5413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:51.423122 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dbb0d-46f2-4a2a-a5e1-f60afceb5413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:51.424957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dbb0d-46f2-4a2a-a5e1-f60afceb5413 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:51.434497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 128/258] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:51.440122 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dbb0d-46f2-4a2a-a5e1-f60afceb5413 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:51.473366 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce3fe-1530-490b-86de-68a4fcee5199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:51.474084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce3fe-1530-490b-86de-68a4fcee5199 None admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:51.474367 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce3fe-1530-490b-86de-68a4fcee5199 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:51.474638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ce3fe-1530-490b-86de-68a4fcee5199 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be/users/ce0a78f0e8854b7a9141a2520e355151/roles/f81ebe87e8a74c24a390dbaafdacdbce` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:51.482522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ce3fe-1530-490b-86de-68a4fcee5199 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eaaf654aca040a7bc85be7d785887be, user_id=ce0a78f0e8854b7a9141a2520e355151, role_id=f81ebe87e8a74c24a390dbaafdacdbce)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:51.483978 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ce3fe-1530-490b-86de-68a4fcee5199 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:51.544113 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dbb0d-46f2-4a2a-a5e1-f60afceb5413 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:51.565682 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:51.578719 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 131/259] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:26:51 2022] PUT /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be/users/ce0a78f0e8854b7a9141a2520e355151/roles/f81ebe87e8a74c24a390dbaafdacdbce => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:26:51.585687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56e84f-76be-44b9-a85e-5fc6a94807bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:51.586359 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56e84f-76be-44b9-a85e-5fc6a94807bc None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:51.586646 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56e84f-76be-44b9-a85e-5fc6a94807bc None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:51.586881 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56e84f-76be-44b9-a85e-5fc6a94807bc None admin] PATH_INFO: `/v3/users/f27a8beb04cd43a2884f77e82c948d11` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:51.588228 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56e84f-76be-44b9-a85e-5fc6a94807bc None admin] RBAC: Authorizing `identity:get_user(user_id=f27a8beb04cd43a2884f77e82c948d11)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:51.589764 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56e84f-76be-44b9-a85e-5fc6a94807bc None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:51.591471 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 129/260] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:51 2022] GET /identity/v3/users/f27a8beb04cd43a2884f77e82c948d11 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:51.596890 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce3fe-1530-490b-86de-68a4fcee5199 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:51.597806 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56e84f-76be-44b9-a85e-5fc6a94807bc None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:51.714235 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:51.784106 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ce3fe-1530-490b-86de-68a4fcee5199 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:51.784435 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56e84f-76be-44b9-a85e-5fc6a94807bc None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:51.855790 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836ad0a-bcef-4e49-bc56-1993be256824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:51.856350 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836ad0a-bcef-4e49-bc56-1993be256824 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:51.856621 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836ad0a-bcef-4e49-bc56-1993be256824 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:51.856910 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836ad0a-bcef-4e49-bc56-1993be256824 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:51.861601 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05166c5a-b39b-425a-83e4-ffa3e774d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:51.862224 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05166c5a-b39b-425a-83e4-ffa3e774d28c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:51.862499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05166c5a-b39b-425a-83e4-ffa3e774d28c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:51.862765 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05166c5a-b39b-425a-83e4-ffa3e774d28c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:51.880833 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836ad0a-bcef-4e49-bc56-1993be256824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-3836ad0a-bcef-4e49-bc56-1993be256824 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:51.888511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:51.890814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:51.892851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 132/261] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:26:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:51.895801 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:51.900761 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836ad0a-bcef-4e49-bc56-1993be256824 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:51.980819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05166c5a-b39b-425a-83e4-ffa3e774d28c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:51.982343 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05166c5a-b39b-425a-83e4-ffa3e774d28c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:52.013678 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836ad0a-bcef-4e49-bc56-1993be256824 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:52.044118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:52.053469 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b26dd-85bf-41eb-9744-f3b89afa5dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:52.054200 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b26dd-85bf-41eb-9744-f3b89afa5dce None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:52.054483 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b26dd-85bf-41eb-9744-f3b89afa5dce None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:52.054756 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b26dd-85bf-41eb-9744-f3b89afa5dce None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:52.055584 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b26dd-85bf-41eb-9744-f3b89afa5dce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:52.055909 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b26dd-85bf-41eb-9744-f3b89afa5dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:52.058245 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b26dd-85bf-41eb-9744-f3b89afa5dce None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:52.067543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 133/262] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:26:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:52.075001 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b26dd-85bf-41eb-9744-f3b89afa5dce None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:52.093857 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 130/263] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:52.104354 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05166c5a-b39b-425a-83e4-ffa3e774d28c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:52.148097 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:52.191803 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b26dd-85bf-41eb-9744-f3b89afa5dce None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:52.205130 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05166c5a-b39b-425a-83e4-ffa3e774d28c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:52.231263 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e74e81-390c-46bd-844d-0bc68d7d3e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:52.231988 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e74e81-390c-46bd-844d-0bc68d7d3e0e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:52.232334 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e74e81-390c-46bd-844d-0bc68d7d3e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:52.232677 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e74e81-390c-46bd-844d-0bc68d7d3e0e None admin] PATH_INFO: `/v3/users/f27a8beb04cd43a2884f77e82c948d11` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:52.233969 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e74e81-390c-46bd-844d-0bc68d7d3e0e None admin] RBAC: Authorizing `identity:get_user(user_id=f27a8beb04cd43a2884f77e82c948d11)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:52.235556 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e74e81-390c-46bd-844d-0bc68d7d3e0e None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:52.237745 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 134/264] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:52 2022] GET /identity/v3/users/f27a8beb04cd43a2884f77e82c948d11 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:52.241901 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d79aeb-ef4b-4e9f-8c33-031366609c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:52.242660 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d79aeb-ef4b-4e9f-8c33-031366609c3b None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:52.242909 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d79aeb-ef4b-4e9f-8c33-031366609c3b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:52.243188 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d79aeb-ef4b-4e9f-8c33-031366609c3b None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:52.243703 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e74e81-390c-46bd-844d-0bc68d7d3e0e None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:52.244499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d79aeb-ef4b-4e9f-8c33-031366609c3b None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:52.246205 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d79aeb-ef4b-4e9f-8c33-031366609c3b None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:52.247973 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 131/265] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:52 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:52.254405 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d79aeb-ef4b-4e9f-8c33-031366609c3b None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:52.318268 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:52.364458 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d79aeb-ef4b-4e9f-8c33-031366609c3b None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:52.366565 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e74e81-390c-46bd-844d-0bc68d7d3e0e None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:52.393100 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:52.405149 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e61ae-fbbb-4024-b6f7-481fa8ca6f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:52.405716 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e61ae-fbbb-4024-b6f7-481fa8ca6f2a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:52.405996 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e61ae-fbbb-4024-b6f7-481fa8ca6f2a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:52.406268 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e61ae-fbbb-4024-b6f7-481fa8ca6f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:52.408039 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e61ae-fbbb-4024-b6f7-481fa8ca6f2a None admin] RBAC: Adding query filter params (role.id=17791940429e48ac98d4bd49aa53a88c, scope.project.id=1eaaf654aca040a7bc85be7d785887be, user.id=f27a8beb04cd43a2884f77e82c948d11) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:52.408353 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e61ae-fbbb-4024-b6f7-481fa8ca6f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:52.410720 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e61ae-fbbb-4024-b6f7-481fa8ca6f2a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:52.413568 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681abd0-d569-442f-a022-0f82f01137ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:52.414171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681abd0-d569-442f-a022-0f82f01137ef None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:52.425991 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681abd0-d569-442f-a022-0f82f01137ef None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:52.426290 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681abd0-d569-442f-a022-0f82f01137ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:52.438956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 132/266] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:52 2022] GET /identity/v3/role_assignments?user.id=f27a8beb04cd43a2884f77e82c948d11&scope.project.id=1eaaf654aca040a7bc85be7d785887be&role.id=17791940429e48ac98d4bd49aa53a88c => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:52.508966 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681abd0-d569-442f-a022-0f82f01137ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:52.510542 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681abd0-d569-442f-a022-0f82f01137ef None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:52.575332 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:52.624438 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 135/267] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 17:26:52.630972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e61ae-fbbb-4024-b6f7-481fa8ca6f2a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:52.779069 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e61ae-fbbb-4024-b6f7-481fa8ca6f2a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:52.822973 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82055536-3ee3-4b4c-a91c-e757aa0b1524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:52.823611 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82055536-3ee3-4b4c-a91c-e757aa0b1524 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:52.823885 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82055536-3ee3-4b4c-a91c-e757aa0b1524 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:52.824154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82055536-3ee3-4b4c-a91c-e757aa0b1524 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:52.825287 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82055536-3ee3-4b4c-a91c-e757aa0b1524 None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:52.826738 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82055536-3ee3-4b4c-a91c-e757aa0b1524 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:52.828658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 133/268] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:52 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:52.834421 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681abd0-d569-442f-a022-0f82f01137ef None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:52.965250 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681abd0-d569-442f-a022-0f82f01137ef None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:53.013900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589683-9c1d-415e-91ea-b02571669e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:53.014869 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589683-9c1d-415e-91ea-b02571669e47 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:53.015345 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589683-9c1d-415e-91ea-b02571669e47 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:53.015832 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589683-9c1d-415e-91ea-b02571669e47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:53.016753 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589683-9c1d-415e-91ea-b02571669e47 None admin] RBAC: Adding query filter params (role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1, scope.project.id=1eaaf654aca040a7bc85be7d785887be, user.id=f27a8beb04cd43a2884f77e82c948d11) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:53.017257 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589683-9c1d-415e-91ea-b02571669e47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:53.018886 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589683-9c1d-415e-91ea-b02571669e47 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:53.029568 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 136/269] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:52 2022] GET /identity/v3/role_assignments?user.id=f27a8beb04cd43a2884f77e82c948d11&scope.project.id=1eaaf654aca040a7bc85be7d785887be&role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:53.555359 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efeaa5-8247-44b1-9b4d-9f10defe56ee None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:53.555745 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efeaa5-8247-44b1-9b4d-9f10defe56ee None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:53.555921 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efeaa5-8247-44b1-9b4d-9f10defe56ee None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:53.558133 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 134/270] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:53.563452 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d8cd-3df3-4355-9cb3-2ad4a3108f1e None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:53.564304 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d8cd-3df3-4355-9cb3-2ad4a3108f1e None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:53.564812 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d8cd-3df3-4355-9cb3-2ad4a3108f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:53.586834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-39b5d8cd-3df3-4355-9cb3-2ad4a3108f1e None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:53.588496 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-39b5d8cd-3df3-4355-9cb3-2ad4a3108f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:53.619885 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:53.687027 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 137/271] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:53.776775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff209a-d73f-492e-8f84-7ac74a6a92c1 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:53.777451 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff209a-d73f-492e-8f84-7ac74a6a92c1 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:53.777451 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff209a-d73f-492e-8f84-7ac74a6a92c1 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:53.778858 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 135/272] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:53.784115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d1534-3b40-4fdc-94ca-1de560a9ddc0 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:53.784395 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d1534-3b40-4fdc-94ca-1de560a9ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:53.784665 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d1534-3b40-4fdc-94ca-1de560a9ddc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:53.803649 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-c11d1534-3b40-4fdc-94ca-1de560a9ddc0 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:53.804850 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-c11d1534-3b40-4fdc-94ca-1de560a9ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:53.873817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 138/273] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:54.037555 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff209a-d73f-492e-8f84-7ac74a6a92c1 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:54.084561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:54.133575 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4a055-0cb3-4af7-b7de-32e469dad8bf None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:54.134080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4a055-0cb3-4af7-b7de-32e469dad8bf None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:54.135023 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4a055-0cb3-4af7-b7de-32e469dad8bf None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:54.136774 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 139/274] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:54.141963 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15eb60-1185-4550-825e-14bb85d42f67 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:54.142471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15eb60-1185-4550-825e-14bb85d42f67 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:54.142942 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15eb60-1185-4550-825e-14bb85d42f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:54.145747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff209a-d73f-492e-8f84-7ac74a6a92c1 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:54.162116 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-2e15eb60-1185-4550-825e-14bb85d42f67 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:54.163653 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-2e15eb60-1185-4550-825e-14bb85d42f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:54.185379 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aff35-82b5-43d1-9c5e-09e3ebf725ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:54.186025 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aff35-82b5-43d1-9c5e-09e3ebf725ca None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:54.186303 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aff35-82b5-43d1-9c5e-09e3ebf725ca None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:54.186573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aff35-82b5-43d1-9c5e-09e3ebf725ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:54.188232 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aff35-82b5-43d1-9c5e-09e3ebf725ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:54.190317 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aff35-82b5-43d1-9c5e-09e3ebf725ca None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:54.192960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 136/275] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:54.198865 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aff35-82b5-43d1-9c5e-09e3ebf725ca None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:54.240508 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 140/276] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:54.249713 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15eb60-1185-4550-825e-14bb85d42f67 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:54.269520 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:54.308473 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aff35-82b5-43d1-9c5e-09e3ebf725ca None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:54.321388 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:54.351378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946e98a-9511-4a59-8eac-eb3834afbf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:54.353117 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946e98a-9511-4a59-8eac-eb3834afbf5e None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:54.353831 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946e98a-9511-4a59-8eac-eb3834afbf5e None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:54.354457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946e98a-9511-4a59-8eac-eb3834afbf5e None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:54.355642 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946e98a-9511-4a59-8eac-eb3834afbf5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:54.357385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946e98a-9511-4a59-8eac-eb3834afbf5e None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:54.388411 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15eb60-1185-4550-825e-14bb85d42f67 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:54.432666 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b9c5f-8dd5-46b0-80bb-b40880cbebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:54.433433 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b9c5f-8dd5-46b0-80bb-b40880cbebe8 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:54.433821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b9c5f-8dd5-46b0-80bb-b40880cbebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:54.434276 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b9c5f-8dd5-46b0-80bb-b40880cbebe8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:54.448409 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b9c5f-8dd5-46b0-80bb-b40880cbebe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-2a6b9c5f-8dd5-46b0-80bb-b40880cbebe8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:54.453264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:54.454140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:54.454981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:54.454981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:54.454981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:54.454981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:54.454981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:54.454981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:54.454981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:54.454981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:54.454981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:54.454981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:54.454981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:54.454981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:54.459171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 141/277] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:54.460070 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b9c5f-8dd5-46b0-80bb-b40880cbebe8 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:54.507437 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 137/278] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 19 17:26:54 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:26:54.532867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6bdc0-b17d-4605-97ca-5500ef2d9f23 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:54.533238 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6bdc0-b17d-4605-97ca-5500ef2d9f23 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:54.533432 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6bdc0-b17d-4605-97ca-5500ef2d9f23 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:54.534858 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 138/279] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:26:54.540407 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b520580-90c3-49c6-bbf1-8978c290709f None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:54.540841 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b520580-90c3-49c6-bbf1-8978c290709f None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:54.541031 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b520580-90c3-49c6-bbf1-8978c290709f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:54.563129 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-7b520580-90c3-49c6-bbf1-8978c290709f None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:54.564451 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-7b520580-90c3-49c6-bbf1-8978c290709f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:54.572515 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:54.603557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b9c5f-8dd5-46b0-80bb-b40880cbebe8 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:54.641427 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 139/280] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:54.642379 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b520580-90c3-49c6-bbf1-8978c290709f None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:54.652950 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647389b4-1acd-4b07-bc58-c408ab77ab22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:54.654399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647389b4-1acd-4b07-bc58-c408ab77ab22 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:54.654963 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647389b4-1acd-4b07-bc58-c408ab77ab22 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:54.655692 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647389b4-1acd-4b07-bc58-c408ab77ab22 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:54.656536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647389b4-1acd-4b07-bc58-c408ab77ab22 None admin] RBAC: Adding query filter params (name=member) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:54.656862 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647389b4-1acd-4b07-bc58-c408ab77ab22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:54.658278 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647389b4-1acd-4b07-bc58-c408ab77ab22 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:54.669782 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 142/281] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:54.678807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647389b4-1acd-4b07-bc58-c408ab77ab22 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:54.770301 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:54.779532 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b520580-90c3-49c6-bbf1-8978c290709f None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:54.806689 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647389b4-1acd-4b07-bc58-c408ab77ab22 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:54.823728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5fe0d-1da2-477b-bfc8-82ee3c23354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:54.823728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5fe0d-1da2-477b-bfc8-82ee3c23354c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:54.823728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5fe0d-1da2-477b-bfc8-82ee3c23354c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:54.823728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5fe0d-1da2-477b-bfc8-82ee3c23354c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:54.834690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5fe0d-1da2-477b-bfc8-82ee3c23354c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-aae5fe0d-1da2-477b-bfc8-82ee3c23354c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:54.840708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:54.841714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:54.842514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:54.842514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:54.842514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:54.842514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:54.842514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:54.842514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:54.842514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:54.842514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:54.842514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:54.842514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:54.842514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:54.842514 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:54.845067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 140/282] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:54.850330 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5fe0d-1da2-477b-bfc8-82ee3c23354c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:54.857036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb05c7-ab71-4dc9-90fc-843448b8f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:54.857765 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb05c7-ab71-4dc9-90fc-843448b8f51e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:54.858112 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb05c7-ab71-4dc9-90fc-843448b8f51e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:54.858463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb05c7-ab71-4dc9-90fc-843448b8f51e None admin] PATH_INFO: `/v3/users/276fa032f65643c79e56dbd2242a536b` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:54.861520 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:54.876094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb05c7-ab71-4dc9-90fc-843448b8f51e None admin] RBAC: Authorizing `identity:get_user(user_id=276fa032f65643c79e56dbd2242a536b)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:54.878346 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb05c7-ab71-4dc9-90fc-843448b8f51e None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:54.880306 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 143/283] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:54 2022] GET /identity/v3/users/276fa032f65643c79e56dbd2242a536b => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:54.886702 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb05c7-ab71-4dc9-90fc-843448b8f51e None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:54.984207 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5fe0d-1da2-477b-bfc8-82ee3c23354c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:55.022480 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb05c7-ab71-4dc9-90fc-843448b8f51e None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:55.028867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d9610-0210-454d-98eb-3149634d4e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:55.029749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d9610-0210-454d-98eb-3149634d4e7c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:55.030325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d9610-0210-454d-98eb-3149634d4e7c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:55.030602 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d9610-0210-454d-98eb-3149634d4e7c None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:55.031265 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d9610-0210-454d-98eb-3149634d4e7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:55.031565 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d9610-0210-454d-98eb-3149634d4e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:55.034025 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d9610-0210-454d-98eb-3149634d4e7c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:55.045643 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 141/284] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:55.047001 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d9610-0210-454d-98eb-3149634d4e7c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:55.067545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9667da2-e82d-4c01-8369-1e8fb03fb825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:55.068750 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9667da2-e82d-4c01-8369-1e8fb03fb825 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:55.069418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9667da2-e82d-4c01-8369-1e8fb03fb825 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:55.069832 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9667da2-e82d-4c01-8369-1e8fb03fb825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:55.070850 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9667da2-e82d-4c01-8369-1e8fb03fb825 None admin] RBAC: Adding query filter params (role.id=f81ebe87e8a74c24a390dbaafdacdbce, user.id=276fa032f65643c79e56dbd2242a536b, scope.system=all) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:55.071324 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9667da2-e82d-4c01-8369-1e8fb03fb825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:55.071552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:55.073405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9667da2-e82d-4c01-8369-1e8fb03fb825 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:55.083266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 144/285] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Aug 19 17:26:54 2022] GET /identity/v3/role_assignments?user.id=276fa032f65643c79e56dbd2242a536b&scope.system=all&role.id=f81ebe87e8a74c24a390dbaafdacdbce => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:55.083266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9667da2-e82d-4c01-8369-1e8fb03fb825 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:55.158270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:55.170734 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d9610-0210-454d-98eb-3149634d4e7c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:55.190783 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9667da2-e82d-4c01-8369-1e8fb03fb825 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:55.211493 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5c08c-0f25-4423-8fcf-4d2a79fb1363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:55.212140 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5c08c-0f25-4423-8fcf-4d2a79fb1363 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:55.212948 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5c08c-0f25-4423-8fcf-4d2a79fb1363 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:55.213238 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5c08c-0f25-4423-8fcf-4d2a79fb1363 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:55.225447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5c08c-0f25-4423-8fcf-4d2a79fb1363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:55.228865 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67733d53-082f-4c01-ad6b-5d889509634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:55.229504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67733d53-082f-4c01-ad6b-5d889509634b None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:55.229784 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67733d53-082f-4c01-ad6b-5d889509634b None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:55.230060 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67733d53-082f-4c01-ad6b-5d889509634b None admin] PATH_INFO: `/v3/users/7047fd76856d489c96a1108e9f5858f0` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:55.231195 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67733d53-082f-4c01-ad6b-5d889509634b None admin] RBAC: Authorizing `identity:get_user(user_id=7047fd76856d489c96a1108e9f5858f0)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-7df5c08c-0f25-4423-8fcf-4d2a79fb1363 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:55.231448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:55.232308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:55.233517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 142/286] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:55.234407 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67733d53-082f-4c01-ad6b-5d889509634b None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:55.234407 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 145/287] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:55 2022] GET /identity/v3/users/7047fd76856d489c96a1108e9f5858f0 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:55.238751 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5c08c-0f25-4423-8fcf-4d2a79fb1363 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:55.239694 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67733d53-082f-4c01-ad6b-5d889509634b None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:55.328061 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:55.354935 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5c08c-0f25-4423-8fcf-4d2a79fb1363 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:55.397624 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67733d53-082f-4c01-ad6b-5d889509634b None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:55.397819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ff988-359d-44f3-9d1f-674742fa6771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:55.398319 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ff988-359d-44f3-9d1f-674742fa6771 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:55.398598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ff988-359d-44f3-9d1f-674742fa6771 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:55.398869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ff988-359d-44f3-9d1f-674742fa6771 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:55.399703 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ff988-359d-44f3-9d1f-674742fa6771 None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:55.401586 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ff988-359d-44f3-9d1f-674742fa6771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:55.402979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ff988-359d-44f3-9d1f-674742fa6771 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:55.412792 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 143/288] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:55.419323 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ff988-359d-44f3-9d1f-674742fa6771 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:55.441363 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:55.462208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaab93-19b8-45fb-aae7-7b179a2001be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:55.463402 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaab93-19b8-45fb-aae7-7b179a2001be None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:55.463678 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaab93-19b8-45fb-aae7-7b179a2001be None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:55.463943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaab93-19b8-45fb-aae7-7b179a2001be None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:55.465771 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaab93-19b8-45fb-aae7-7b179a2001be None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:55.467356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaab93-19b8-45fb-aae7-7b179a2001be None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:55.469238 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 146/289] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:55 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:55.475305 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaab93-19b8-45fb-aae7-7b179a2001be None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:55.587187 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ff988-359d-44f3-9d1f-674742fa6771 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:55.603411 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaab93-19b8-45fb-aae7-7b179a2001be None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:55.655419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a3f78-2265-4419-8b5a-9d24e1be611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:55.655973 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a3f78-2265-4419-8b5a-9d24e1be611b None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:55.656249 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a3f78-2265-4419-8b5a-9d24e1be611b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:55.656522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a3f78-2265-4419-8b5a-9d24e1be611b None admin] PATH_INFO: `/v3/users/ce0a78f0e8854b7a9141a2520e355151` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:55.658865 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254bdc-c3cc-43ce-ac0c-30f104fcb4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:55.659558 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254bdc-c3cc-43ce-ac0c-30f104fcb4b1 None admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:55.659866 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254bdc-c3cc-43ce-ac0c-30f104fcb4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:55.660105 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254bdc-c3cc-43ce-ac0c-30f104fcb4b1 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be/users/7047fd76856d489c96a1108e9f5858f0/roles/783aa30fbf304861957e0d234b935acf` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:55.661148 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a3f78-2265-4419-8b5a-9d24e1be611b None admin] RBAC: Authorizing `identity:get_user(user_id=ce0a78f0e8854b7a9141a2520e355151)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:55.663153 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a3f78-2265-4419-8b5a-9d24e1be611b None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:55.665539 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254bdc-c3cc-43ce-ac0c-30f104fcb4b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eaaf654aca040a7bc85be7d785887be, user_id=7047fd76856d489c96a1108e9f5858f0, role_id=783aa30fbf304861957e0d234b935acf)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:55.667020 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254bdc-c3cc-43ce-ac0c-30f104fcb4b1 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:55.670141 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 144/290] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:55 2022] GET /identity/v3/users/ce0a78f0e8854b7a9141a2520e355151 => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:55.670734 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a3f78-2265-4419-8b5a-9d24e1be611b None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:55.689272 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:55.788870 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a3f78-2265-4419-8b5a-9d24e1be611b None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:55.795149 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 147/291] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:26:55 2022] PUT /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be/users/7047fd76856d489c96a1108e9f5858f0/roles/783aa30fbf304861957e0d234b935acf => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:26:55.827630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82227f-ba4d-43d0-b15a-b53d32638537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:55.828306 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82227f-ba4d-43d0-b15a-b53d32638537 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:55.828591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82227f-ba4d-43d0-b15a-b53d32638537 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:55.828898 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82227f-ba4d-43d0-b15a-b53d32638537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:55.905124 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82227f-ba4d-43d0-b15a-b53d32638537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:55.906681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82227f-ba4d-43d0-b15a-b53d32638537 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:55.925575 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:56.015397 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 145/292] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:56.021109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254bdc-c3cc-43ce-ac0c-30f104fcb4b1 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:56.092185 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:56.150458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254bdc-c3cc-43ce-ac0c-30f104fcb4b1 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:56.187425 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2ed18-891e-48be-bc97-1e630f5000c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:56.188063 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2ed18-891e-48be-bc97-1e630f5000c1 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:56.188342 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2ed18-891e-48be-bc97-1e630f5000c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:56.188616 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2ed18-891e-48be-bc97-1e630f5000c1 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:56.189769 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2ed18-891e-48be-bc97-1e630f5000c1 None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:56.191214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2ed18-891e-48be-bc97-1e630f5000c1 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:56.193175 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 148/293] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:56 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:56.199814 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82227f-ba4d-43d0-b15a-b53d32638537 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:56.304120 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82227f-ba4d-43d0-b15a-b53d32638537 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:56.313827 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:56.339521 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51c497-bcee-4ff3-a4ef-59fbb15b521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:56.340128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51c497-bcee-4ff3-a4ef-59fbb15b521f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:56.340528 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51c497-bcee-4ff3-a4ef-59fbb15b521f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:56.340836 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51c497-bcee-4ff3-a4ef-59fbb15b521f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:56.341559 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51c497-bcee-4ff3-a4ef-59fbb15b521f None admin] RBAC: Adding query filter params (role.id=f81ebe87e8a74c24a390dbaafdacdbce, scope.project.id=1eaaf654aca040a7bc85be7d785887be, user.id=ce0a78f0e8854b7a9141a2520e355151) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:56.341871 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51c497-bcee-4ff3-a4ef-59fbb15b521f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:56.343314 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51c497-bcee-4ff3-a4ef-59fbb15b521f None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:56.350108 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 146/294] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:56 2022] GET /identity/v3/role_assignments?user.id=ce0a78f0e8854b7a9141a2520e355151&scope.project.id=1eaaf654aca040a7bc85be7d785887be&role.id=f81ebe87e8a74c24a390dbaafdacdbce => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:57.299974 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22cf4f-bb06-41b2-bc97-05c6d4a73815 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:57.301014 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22cf4f-bb06-41b2-bc97-05c6d4a73815 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:57.301521 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22cf4f-bb06-41b2-bc97-05c6d4a73815 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:57.303286 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 149/295] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:57.308611 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad2c47-9e47-4cda-a061-043796905bdd None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:57.309447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad2c47-9e47-4cda-a061-043796905bdd None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:57.309915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad2c47-9e47-4cda-a061-043796905bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:57.329135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-82ad2c47-9e47-4cda-a061-043796905bdd None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:57.330614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-82ad2c47-9e47-4cda-a061-043796905bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:57.358747 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ac01a-e9db-4cf0-884d-38147f7a622e None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:57.359365 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ac01a-e9db-4cf0-884d-38147f7a622e None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:57.359840 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ac01a-e9db-4cf0-884d-38147f7a622e None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:57.361665 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 150/296] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:57.366895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87308249-1fb7-4d38-a9c0-38d86e389186 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:57.367425 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87308249-1fb7-4d38-a9c0-38d86e389186 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:57.367902 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87308249-1fb7-4d38-a9c0-38d86e389186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:57.387391 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-87308249-1fb7-4d38-a9c0-38d86e389186 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:57.388940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-87308249-1fb7-4d38-a9c0-38d86e389186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:57.416777 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 147/297] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:57.470380 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 151/298] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:57.753357 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad2c47-9e47-4cda-a061-043796905bdd None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:57.810162 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87308249-1fb7-4d38-a9c0-38d86e389186 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:57.863978 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:57.868018 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad2c47-9e47-4cda-a061-043796905bdd None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:57.870296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:57.902538 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61e932-c122-42c3-8033-bf052d0fde2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:57.903166 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61e932-c122-42c3-8033-bf052d0fde2e None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:57.903441 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61e932-c122-42c3-8033-bf052d0fde2e None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:57.903706 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61e932-c122-42c3-8033-bf052d0fde2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:57.904815 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61e932-c122-42c3-8033-bf052d0fde2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:57.906243 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61e932-c122-42c3-8033-bf052d0fde2e None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:57.907953 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 148/299] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:26:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:57.908885 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13325de1-87e4-4667-a862-0a7fed5fd50b None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:57.909344 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13325de1-87e4-4667-a862-0a7fed5fd50b None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:57.909754 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13325de1-87e4-4667-a862-0a7fed5fd50b None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:57.915001 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 149/300] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:57.916466 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13325de1-87e4-4667-a862-0a7fed5fd50b None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:57.921802 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87308249-1fb7-4d38-a9c0-38d86e389186 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:57.957541 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a409b-9e5e-45d7-84be-8a991a4c2e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:57.958161 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a409b-9e5e-45d7-84be-8a991a4c2e73 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:57.958615 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a409b-9e5e-45d7-84be-8a991a4c2e73 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:57.958889 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a409b-9e5e-45d7-84be-8a991a4c2e73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:57.969045 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a409b-9e5e-45d7-84be-8a991a4c2e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-371a409b-9e5e-45d7-84be-8a991a4c2e73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:57.973847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:57.974706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:26:57.975491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 152/301] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:26:57.976132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d791fbb-c8b7-4ff4-97fe-fd50555ea947 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:57.976357 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d791fbb-c8b7-4ff4-97fe-fd50555ea947 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:57.976825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d791fbb-c8b7-4ff4-97fe-fd50555ea947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:57.996279 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-9d791fbb-c8b7-4ff4-97fe-fd50555ea947 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:57.997749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-9d791fbb-c8b7-4ff4-97fe-fd50555ea947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:58.030895 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13325de1-87e4-4667-a862-0a7fed5fd50b None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:58.069795 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 153/302] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:26:58.071381 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d791fbb-c8b7-4ff4-97fe-fd50555ea947 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:58.076227 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8d889-b36e-4b28-8a74-44bf07a8c134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:58.077047 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8d889-b36e-4b28-8a74-44bf07a8c134 None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:58.077474 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8d889-b36e-4b28-8a74-44bf07a8c134 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:58.082654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8d889-b36e-4b28-8a74-44bf07a8c134 None admin] PATH_INFO: `/v3/groups` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:58.082654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8d889-b36e-4b28-8a74-44bf07a8c134 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:58.082654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8d889-b36e-4b28-8a74-44bf07a8c134 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:58.115848 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:58.162088 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 150/303] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Aug 19 17:26:57 2022] POST /identity/v3/groups => generated 229 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:26:58.190070 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d791fbb-c8b7-4ff4-97fe-fd50555ea947 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:58.231952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14133137-d8e6-47b1-80c3-3e867ea05848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:58.232953 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14133137-d8e6-47b1-80c3-3e867ea05848 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:58.233510 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14133137-d8e6-47b1-80c3-3e867ea05848 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:58.234008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14133137-d8e6-47b1-80c3-3e867ea05848 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:58.234914 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14133137-d8e6-47b1-80c3-3e867ea05848 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:58.235437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14133137-d8e6-47b1-80c3-3e867ea05848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:58.237100 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14133137-d8e6-47b1-80c3-3e867ea05848 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:58.247547 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 154/304] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:58.253939 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8d889-b36e-4b28-8a74-44bf07a8c134 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:58.287866 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:58.353969 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c937c4-88ff-4f83-bab4-41451539c8d0 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:58.355210 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c937c4-88ff-4f83-bab4-41451539c8d0 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:58.355467 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c937c4-88ff-4f83-bab4-41451539c8d0 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:58.357126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 155/305] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:26:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:26:58.362880 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f7025-a132-4387-bb4e-60a2767ce801 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:58.363476 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f7025-a132-4387-bb4e-60a2767ce801 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:58.363976 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f7025-a132-4387-bb4e-60a2767ce801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:58.371893 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8d889-b36e-4b28-8a74-44bf07a8c134 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:58.387311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-763f7025-a132-4387-bb4e-60a2767ce801 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:26:58.388512 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-763f7025-a132-4387-bb4e-60a2767ce801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:26:58.418540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1812d4-c618-4e5d-9d4d-1572835f29c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:58.418540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1812d4-c618-4e5d-9d4d-1572835f29c1 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:58.418540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1812d4-c618-4e5d-9d4d-1572835f29c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:58.418540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1812d4-c618-4e5d-9d4d-1572835f29c1 None admin] PATH_INFO: `/v3/users/2876952f4f2e455b965d294b2f9b7e90` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:58.437378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1812d4-c618-4e5d-9d4d-1572835f29c1 None admin] RBAC: Authorizing `identity:get_user(user_id=2876952f4f2e455b965d294b2f9b7e90)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:58.439204 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1812d4-c618-4e5d-9d4d-1572835f29c1 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:58.441106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 151/306] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:58 2022] GET /identity/v3/users/2876952f4f2e455b965d294b2f9b7e90 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:58.444585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1812d4-c618-4e5d-9d4d-1572835f29c1 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:58.477987 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 156/307] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:26:58.479601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f7025-a132-4387-bb4e-60a2767ce801 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:58.511238 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:58.547320 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:58.560138 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1812d4-c618-4e5d-9d4d-1572835f29c1 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:58.590657 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f7025-a132-4387-bb4e-60a2767ce801 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:58.596194 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b1561-2b92-497a-902f-ac6078ac4698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:58.597097 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b1561-2b92-497a-902f-ac6078ac4698 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:58.597708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b1561-2b92-497a-902f-ac6078ac4698 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:58.598160 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b1561-2b92-497a-902f-ac6078ac4698 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:58.609480 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b1561-2b92-497a-902f-ac6078ac4698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-655b1561-2b92-497a-902f-ac6078ac4698 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:58.614772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:58.615663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:58.616455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:58.616455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:58.616455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:58.616455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:58.616455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:58.616455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:58.616455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:58.616455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:58.616455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:58.616455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:58.616455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:26:58.616455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:58.619103 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 152/308] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:26:58.625314 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b1561-2b92-497a-902f-ac6078ac4698 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:58.630171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b05c8-7713-4479-9395-1271d772bd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:58.631859 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b05c8-7713-4479-9395-1271d772bd4c None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:58.632319 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b05c8-7713-4479-9395-1271d772bd4c None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:58.632835 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b05c8-7713-4479-9395-1271d772bd4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:58.633736 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b05c8-7713-4479-9395-1271d772bd4c None admin] RBAC: Adding query filter params (role.id=783aa30fbf304861957e0d234b935acf, user.id=2876952f4f2e455b965d294b2f9b7e90, scope.system=all) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:58.634216 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b05c8-7713-4479-9395-1271d772bd4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:58.636896 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b05c8-7713-4479-9395-1271d772bd4c None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:58.652962 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 157/309] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Aug 19 17:26:58 2022] GET /identity/v3/role_assignments?user.id=2876952f4f2e455b965d294b2f9b7e90&scope.system=all&role.id=783aa30fbf304861957e0d234b935acf => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:58.758580 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b1561-2b92-497a-902f-ac6078ac4698 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:58.797455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cc329-1638-42db-91e9-6badea9277aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:58.798055 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cc329-1638-42db-91e9-6badea9277aa None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:58.798333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cc329-1638-42db-91e9-6badea9277aa None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:58.798612 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cc329-1638-42db-91e9-6badea9277aa None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:58.799329 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cc329-1638-42db-91e9-6badea9277aa None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:58.799625 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cc329-1638-42db-91e9-6badea9277aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:58.801094 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cc329-1638-42db-91e9-6badea9277aa None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:58.811447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 153/310] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:58.817059 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b05c8-7713-4479-9395-1271d772bd4c None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:58.819455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cc329-1638-42db-91e9-6badea9277aa None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:58.833811 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:58.939681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:58.946018 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b05c8-7713-4479-9395-1271d772bd4c None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:58.951341 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cc329-1638-42db-91e9-6badea9277aa None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:58.983277 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c7e97-abc2-4430-8d76-ca97fb5a8ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:58.984353 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c7e97-abc2-4430-8d76-ca97fb5a8ac4 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:58.984704 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c7e97-abc2-4430-8d76-ca97fb5a8ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:58.985216 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c7e97-abc2-4430-8d76-ca97fb5a8ac4 None admin] PATH_INFO: `/v3/users/276fa032f65643c79e56dbd2242a536b` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:58.986712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c7e97-abc2-4430-8d76-ca97fb5a8ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=276fa032f65643c79e56dbd2242a536b)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:58.988849 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c7e97-abc2-4430-8d76-ca97fb5a8ac4 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:58.995589 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 158/311] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:58 2022] GET /identity/v3/users/276fa032f65643c79e56dbd2242a536b => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:58.996792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c7e97-abc2-4430-8d76-ca97fb5a8ac4 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:59.001534 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99e32b-7659-43fd-bddc-19ac08fc27c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:59.002445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99e32b-7659-43fd-bddc-19ac08fc27c6 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:59.002947 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99e32b-7659-43fd-bddc-19ac08fc27c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:59.003417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99e32b-7659-43fd-bddc-19ac08fc27c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:59.026016 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99e32b-7659-43fd-bddc-19ac08fc27c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-ab99e32b-7659-43fd-bddc-19ac08fc27c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:26:59.034009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:26:59.034910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:26:59.035691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:26:59.035691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:26:59.035691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:26:59.035691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:26:59.035691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:26:59.035691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:26:59.035691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:26:59.035691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:26:59.035691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:26:59.035691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:26:59.035691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:26:59.035691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:26:59.039908 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 154/312] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:26:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:26:59.046192 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99e32b-7659-43fd-bddc-19ac08fc27c6 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:59.123611 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c7e97-abc2-4430-8d76-ca97fb5a8ac4 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:59.140323 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:59.173469 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99e32b-7659-43fd-bddc-19ac08fc27c6 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:59.213788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2b770-6586-47d2-8b99-5520bd4462c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:59.214417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b770-6586-47d2-8b99-5520bd4462c2 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:59.214772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b770-6586-47d2-8b99-5520bd4462c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:59.215050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b770-6586-47d2-8b99-5520bd4462c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:59.215837 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2b770-6586-47d2-8b99-5520bd4462c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:26:59.216125 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2b770-6586-47d2-8b99-5520bd4462c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:59.216911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e80712-6d5d-4054-ba4a-4a000c25edf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:59.217539 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2b770-6586-47d2-8b99-5520bd4462c2 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:59.218000 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e80712-6d5d-4054-ba4a-4a000c25edf9 None admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:59.218501 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e80712-6d5d-4054-ba4a-4a000c25edf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:59.219157 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e80712-6d5d-4054-ba4a-4a000c25edf9 None admin] PATH_INFO: `/v3/system/users/276fa032f65643c79e56dbd2242a536b/roles/f81ebe87e8a74c24a390dbaafdacdbce` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:59.221290 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e80712-6d5d-4054-ba4a-4a000c25edf9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=276fa032f65643c79e56dbd2242a536b, role_id=f81ebe87e8a74c24a390dbaafdacdbce)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:59.222860 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e80712-6d5d-4054-ba4a-4a000c25edf9 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:59.226427 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 155/313] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:26:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:26:59.233295 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2b770-6586-47d2-8b99-5520bd4462c2 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:59.316588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 159/314] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Aug 19 17:26:58 2022] PUT /identity/v3/system/users/276fa032f65643c79e56dbd2242a536b/roles/f81ebe87e8a74c24a390dbaafdacdbce => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 17:26:59.365416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2b770-6586-47d2-8b99-5520bd4462c2 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:59.400364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:59.405829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f20a98-cf5f-45fc-a6c6-027ac56fe23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:59.406492 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20a98-cf5f-45fc-a6c6-027ac56fe23c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:59.406773 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20a98-cf5f-45fc-a6c6-027ac56fe23c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:59.407046 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20a98-cf5f-45fc-a6c6-027ac56fe23c None admin] PATH_INFO: `/v3/users/7047fd76856d489c96a1108e9f5858f0` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:59.408416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f20a98-cf5f-45fc-a6c6-027ac56fe23c None admin] RBAC: Authorizing `identity:get_user(user_id=7047fd76856d489c96a1108e9f5858f0)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:59.410007 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f20a98-cf5f-45fc-a6c6-027ac56fe23c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:59.412293 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 156/315] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:26:59 2022] GET /identity/v3/users/7047fd76856d489c96a1108e9f5858f0 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:59.427717 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e80712-6d5d-4054-ba4a-4a000c25edf9 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:59.461507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:59.541701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e80712-6d5d-4054-ba4a-4a000c25edf9 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:59.577066 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049eaace-16be-4bc3-9a2f-c8447f975072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:59.577665 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eaace-16be-4bc3-9a2f-c8447f975072 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:59.577944 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eaace-16be-4bc3-9a2f-c8447f975072 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:59.578213 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eaace-16be-4bc3-9a2f-c8447f975072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:59.655915 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049eaace-16be-4bc3-9a2f-c8447f975072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:59.657343 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049eaace-16be-4bc3-9a2f-c8447f975072 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:59.686128 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:26:59.767550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 160/316] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:26:59.773835 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f20a98-cf5f-45fc-a6c6-027ac56fe23c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:26:59.887737 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f20a98-cf5f-45fc-a6c6-027ac56fe23c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:26:59.922754 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a14ad-bc66-4697-b2cd-e67e988244db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:26:59.923452 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a14ad-bc66-4697-b2cd-e67e988244db None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:26:59.923735 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a14ad-bc66-4697-b2cd-e67e988244db None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:26:59.924005 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a14ad-bc66-4697-b2cd-e67e988244db None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:26:59.925148 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a14ad-bc66-4697-b2cd-e67e988244db None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:26:59.926596 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a14ad-bc66-4697-b2cd-e67e988244db None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:26:59.928281 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 157/317] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:26:59 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:26:59.934704 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049eaace-16be-4bc3-9a2f-c8447f975072 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:00.036979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049eaace-16be-4bc3-9a2f-c8447f975072 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:00.064691 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:00.073879 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc68814-584f-4050-9419-79640eea055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:00.074539 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc68814-584f-4050-9419-79640eea055a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:00.074875 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc68814-584f-4050-9419-79640eea055a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:00.081056 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc68814-584f-4050-9419-79640eea055a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:00.081056 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc68814-584f-4050-9419-79640eea055a None admin] RBAC: Adding query filter params (role.id=783aa30fbf304861957e0d234b935acf, scope.project.id=1eaaf654aca040a7bc85be7d785887be, user.id=7047fd76856d489c96a1108e9f5858f0) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:00.081056 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc68814-584f-4050-9419-79640eea055a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:00.081056 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc68814-584f-4050-9419-79640eea055a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:00.088012 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 161/318] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:26:59 2022] GET /identity/v3/role_assignments?user.id=7047fd76856d489c96a1108e9f5858f0&scope.project.id=1eaaf654aca040a7bc85be7d785887be&role.id=783aa30fbf304861957e0d234b935acf => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:00.504007 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b512a4-3b57-414f-9637-610369111066 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:00.504531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b512a4-3b57-414f-9637-610369111066 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:00.504531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b512a4-3b57-414f-9637-610369111066 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:00.506144 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 158/319] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:00.511825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d67ff-622c-4fad-bf4f-dd8e7f305b77 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:00.512323 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d67ff-622c-4fad-bf4f-dd8e7f305b77 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:00.512396 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d67ff-622c-4fad-bf4f-dd8e7f305b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:00.530862 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-175d67ff-622c-4fad-bf4f-dd8e7f305b77 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:00.532059 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-175d67ff-622c-4fad-bf4f-dd8e7f305b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:00.601208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 162/320] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:00.910740 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dada3-6bde-4d09-9c00-0da79bcd9115 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:00.911072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dada3-6bde-4d09-9c00-0da79bcd9115 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:00.911242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dada3-6bde-4d09-9c00-0da79bcd9115 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:00.912517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 159/321] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:00.917794 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81792d07-486b-4647-a367-3b5c0f0f7fdf None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:00.918076 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81792d07-486b-4647-a367-3b5c0f0f7fdf None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:00.918341 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81792d07-486b-4647-a367-3b5c0f0f7fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:00.926543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dada3-6bde-4d09-9c00-0da79bcd9115 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:00.936933 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-81792d07-486b-4647-a367-3b5c0f0f7fdf None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:00.938098 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-81792d07-486b-4647-a367-3b5c0f0f7fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:00.996106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:01.011181 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 163/322] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:01.034275 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dada3-6bde-4d09-9c00-0da79bcd9115 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:01.072598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66682bcd-b3ec-46de-a837-bde52f6b56db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:01.073465 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66682bcd-b3ec-46de-a837-bde52f6b56db None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:01.073974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66682bcd-b3ec-46de-a837-bde52f6b56db None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:01.074392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66682bcd-b3ec-46de-a837-bde52f6b56db None admin] PATH_INFO: `/v3/domains/default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:01.075618 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66682bcd-b3ec-46de-a837-bde52f6b56db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:01.077260 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66682bcd-b3ec-46de-a837-bde52f6b56db None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:01.083482 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 160/323] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:01.087495 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81792d07-486b-4647-a367-3b5c0f0f7fdf None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:01.170663 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:01.218212 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81792d07-486b-4647-a367-3b5c0f0f7fdf None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:01.252189 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b42a28-20e7-4b9f-9bbd-afc3dbd202a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:01.252828 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b42a28-20e7-4b9f-9bbd-afc3dbd202a2 None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:01.253109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b42a28-20e7-4b9f-9bbd-afc3dbd202a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:01.253381 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b42a28-20e7-4b9f-9bbd-afc3dbd202a2 None admin] PATH_INFO: `/v3/groups` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:01.253992 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b42a28-20e7-4b9f-9bbd-afc3dbd202a2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:01.255423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b42a28-20e7-4b9f-9bbd-afc3dbd202a2 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:01.339138 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66682bcd-b3ec-46de-a837-bde52f6b56db None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:01.364766 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 164/324] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Aug 19 17:27:01 2022] POST /identity/v3/groups => generated 226 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:27:01.458655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66682bcd-b3ec-46de-a837-bde52f6b56db None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:01.500376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1e913-7a94-43de-afa5-c2498942c517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:01.501056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1e913-7a94-43de-afa5-c2498942c517 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:01.501331 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1e913-7a94-43de-afa5-c2498942c517 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:01.501605 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1e913-7a94-43de-afa5-c2498942c517 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:01.504675 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:01.515662 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1e913-7a94-43de-afa5-c2498942c517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-8bb1e913-7a94-43de-afa5-c2498942c517 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:01.520574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:01.521659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:01.522447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:01.522447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:01.522447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:01.522447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:01.522447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:01.522447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:01.522447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:01.522447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:01.522447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:01.522447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:01.522447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:27:01.522447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:01.525625 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 161/325] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:01.528276 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b42a28-20e7-4b9f-9bbd-afc3dbd202a2 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:01.603685 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea623c38-5b74-4c40-8255-caa2e2408e17 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:01.603967 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea623c38-5b74-4c40-8255-caa2e2408e17 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:01.604192 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea623c38-5b74-4c40-8255-caa2e2408e17 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:01.606930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 162/326] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:01.610693 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e4f1b-152b-4ab9-8091-8d853c230c7f None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:01.610981 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e4f1b-152b-4ab9-8091-8d853c230c7f None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:01.611255 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e4f1b-152b-4ab9-8091-8d853c230c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:01.629956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-8f9e4f1b-152b-4ab9-8091-8d853c230c7f None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:01.631158 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-8f9e4f1b-152b-4ab9-8091-8d853c230c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:01.643375 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b42a28-20e7-4b9f-9bbd-afc3dbd202a2 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:01.657857 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:01.682533 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863c2e6-0b44-4f0c-8b01-6c38fb1bf59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:01.683122 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863c2e6-0b44-4f0c-8b01-6c38fb1bf59a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:01.683404 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863c2e6-0b44-4f0c-8b01-6c38fb1bf59a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:01.683679 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863c2e6-0b44-4f0c-8b01-6c38fb1bf59a None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:01.684359 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863c2e6-0b44-4f0c-8b01-6c38fb1bf59a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:01.684762 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863c2e6-0b44-4f0c-8b01-6c38fb1bf59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:01.686109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863c2e6-0b44-4f0c-8b01-6c38fb1bf59a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:01.700920 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 165/327] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:27:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:01.710381 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863c2e6-0b44-4f0c-8b01-6c38fb1bf59a None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:01.727105 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 163/328] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:01.824431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863c2e6-0b44-4f0c-8b01-6c38fb1bf59a None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:01.865109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdf5b2-2a80-471a-9912-39f9a992fce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:01.865741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdf5b2-2a80-471a-9912-39f9a992fce1 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:01.866014 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdf5b2-2a80-471a-9912-39f9a992fce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:01.866285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdf5b2-2a80-471a-9912-39f9a992fce1 None admin] PATH_INFO: `/v3/users/2876952f4f2e455b965d294b2f9b7e90` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:01.867406 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdf5b2-2a80-471a-9912-39f9a992fce1 None admin] RBAC: Authorizing `identity:get_user(user_id=2876952f4f2e455b965d294b2f9b7e90)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:01.868913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdf5b2-2a80-471a-9912-39f9a992fce1 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:01.870793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 166/329] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:27:01 2022] GET /identity/v3/users/2876952f4f2e455b965d294b2f9b7e90 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:01.876805 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e4f1b-152b-4ab9-8091-8d853c230c7f None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:01.988342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e4f1b-152b-4ab9-8091-8d853c230c7f None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:02.021183 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:02.025416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac6aa3-63f3-42a1-b33a-1f6d9aaccc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:02.026080 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac6aa3-63f3-42a1-b33a-1f6d9aaccc02 None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:02.027985 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac6aa3-63f3-42a1-b33a-1f6d9aaccc02 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:02.028267 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac6aa3-63f3-42a1-b33a-1f6d9aaccc02 None admin] PATH_INFO: `/v3/system/users/2876952f4f2e455b965d294b2f9b7e90/roles/783aa30fbf304861957e0d234b935acf` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:02.029739 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac6aa3-63f3-42a1-b33a-1f6d9aaccc02 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2876952f4f2e455b965d294b2f9b7e90, role_id=783aa30fbf304861957e0d234b935acf)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:02.031256 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac6aa3-63f3-42a1-b33a-1f6d9aaccc02 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:02.083160 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdf5b2-2a80-471a-9912-39f9a992fce1 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:02.114224 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 164/330] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Aug 19 17:27:01 2022] PUT /identity/v3/system/users/2876952f4f2e455b965d294b2f9b7e90/roles/783aa30fbf304861957e0d234b935acf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 17:27:02.133551 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:02.209766 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdf5b2-2a80-471a-9912-39f9a992fce1 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:02.249520 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915b43e-c618-4a54-a835-02359fe46c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:02.250084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915b43e-c618-4a54-a835-02359fe46c47 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:02.250367 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915b43e-c618-4a54-a835-02359fe46c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:02.250647 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915b43e-c618-4a54-a835-02359fe46c47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:02.263127 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915b43e-c618-4a54-a835-02359fe46c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-1915b43e-c618-4a54-a835-02359fe46c47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:02.268030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:02.269006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:02.269824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 167/331] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:02.275247 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac6aa3-63f3-42a1-b33a-1f6d9aaccc02 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:02.386541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac6aa3-63f3-42a1-b33a-1f6d9aaccc02 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:02.423190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afb32f-bff6-483f-aa91-63e9a66656bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:02.423608 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afb32f-bff6-483f-aa91-63e9a66656bf None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:02.423803 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afb32f-bff6-483f-aa91-63e9a66656bf None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:02.424075 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afb32f-bff6-483f-aa91-63e9a66656bf None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:02.424769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afb32f-bff6-483f-aa91-63e9a66656bf None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:02.425080 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afb32f-bff6-483f-aa91-63e9a66656bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:02.432088 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afb32f-bff6-483f-aa91-63e9a66656bf None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:02.437694 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 165/332] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:27:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:02.443610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915b43e-c618-4a54-a835-02359fe46c47 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:02.586832 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915b43e-c618-4a54-a835-02359fe46c47 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:02.588348 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:02.629438 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c81edc-43b1-4839-9f66-11e410f6ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:02.630072 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81edc-43b1-4839-9f66-11e410f6ac23 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:02.630401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81edc-43b1-4839-9f66-11e410f6ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:02.630679 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81edc-43b1-4839-9f66-11e410f6ac23 None admin] PATH_INFO: `/v3/users/276fa032f65643c79e56dbd2242a536b` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:02.633280 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c81edc-43b1-4839-9f66-11e410f6ac23 None admin] RBAC: Authorizing `identity:get_user(user_id=276fa032f65643c79e56dbd2242a536b)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:02.634783 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c81edc-43b1-4839-9f66-11e410f6ac23 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:02.636398 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 168/333] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:27:02 2022] GET /identity/v3/users/276fa032f65643c79e56dbd2242a536b => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:02.642574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afb32f-bff6-483f-aa91-63e9a66656bf None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:02.724737 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:02.786079 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afb32f-bff6-483f-aa91-63e9a66656bf None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:02.821428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcc245-d7e4-4ca6-8e7f-0e7b17b18024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:02.822608 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcc245-d7e4-4ca6-8e7f-0e7b17b18024 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:02.822892 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcc245-d7e4-4ca6-8e7f-0e7b17b18024 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:02.823171 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcc245-d7e4-4ca6-8e7f-0e7b17b18024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:02.823901 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcc245-d7e4-4ca6-8e7f-0e7b17b18024 None admin] RBAC: Adding query filter params (role.id=f81ebe87e8a74c24a390dbaafdacdbce, user.id=276fa032f65643c79e56dbd2242a536b, scope.system=all) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:02.824210 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcc245-d7e4-4ca6-8e7f-0e7b17b18024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:02.825751 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcc245-d7e4-4ca6-8e7f-0e7b17b18024 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:02.844938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 166/334] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Aug 19 17:27:02 2022] GET /identity/v3/role_assignments?user.id=276fa032f65643c79e56dbd2242a536b&scope.system=all&role.id=f81ebe87e8a74c24a390dbaafdacdbce => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:04.901451 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b67e2-8721-4746-8845-126587f3d1cc None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:04.901969 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b67e2-8721-4746-8845-126587f3d1cc None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:04.901969 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b67e2-8721-4746-8845-126587f3d1cc None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:04.903745 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 169/335] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:04.909336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10456ff1-4854-4f89-acdb-e933cbf89ca9 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:04.909791 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10456ff1-4854-4f89-acdb-e933cbf89ca9 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:04.909883 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10456ff1-4854-4f89-acdb-e933cbf89ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:04.935395 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-10456ff1-4854-4f89-acdb-e933cbf89ca9 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:04.936636 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-10456ff1-4854-4f89-acdb-e933cbf89ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:05.022390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 167/336] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:05.081265 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d055c-cc19-4542-bc4f-522be582915c None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:05.094492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d055c-cc19-4542-bc4f-522be582915c None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:05.094492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d055c-cc19-4542-bc4f-522be582915c None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:05.094492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 170/337] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:05.094744 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bc7f2-613e-4bd3-9ac7-34b32be80223 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:05.094744 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bc7f2-613e-4bd3-9ac7-34b32be80223 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:05.094744 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bc7f2-613e-4bd3-9ac7-34b32be80223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:05.107504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-e67bc7f2-613e-4bd3-9ac7-34b32be80223 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:05.108701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-e67bc7f2-613e-4bd3-9ac7-34b32be80223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:05.147669 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:05.154992 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43301-0f47-439d-bf7f-6c08db84fd0c None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:05.155227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43301-0f47-439d-bf7f-6c08db84fd0c None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:05.155468 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43301-0f47-439d-bf7f-6c08db84fd0c None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:05.157164 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 171/338] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:05.162048 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fbb8e-27d6-482f-8e55-5d6e12170a1d None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:05.162330 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fbb8e-27d6-482f-8e55-5d6e12170a1d None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:05.162608 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fbb8e-27d6-482f-8e55-5d6e12170a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:05.195091 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 168/339] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:05.204202 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-bd6fbb8e-27d6-482f-8e55-5d6e12170a1d None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:05.205449 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-bd6fbb8e-27d6-482f-8e55-5d6e12170a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:05.299201 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 172/340] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:05.487308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bc7f2-613e-4bd3-9ac7-34b32be80223 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:05.585355 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f061aa-0f50-44e1-a6e8-9188253dedb2 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:05.585992 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f061aa-0f50-44e1-a6e8-9188253dedb2 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:05.586468 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f061aa-0f50-44e1-a6e8-9188253dedb2 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:05.592419 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 173/341] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:05.593837 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114e644-77e4-4a7b-b275-8499db44ff4a None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:05.594360 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114e644-77e4-4a7b-b275-8499db44ff4a None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:05.594851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114e644-77e4-4a7b-b275-8499db44ff4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:05.604494 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bc7f2-613e-4bd3-9ac7-34b32be80223 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:05.634935 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-d114e644-77e4-4a7b-b275-8499db44ff4a None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:05.636216 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-d114e644-77e4-4a7b-b275-8499db44ff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:05.653029 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2a064-dbef-49b0-b031-3b159ede3708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:05.653778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2a064-dbef-49b0-b031-3b159ede3708 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:05.654062 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2a064-dbef-49b0-b031-3b159ede3708 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:05.654338 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2a064-dbef-49b0-b031-3b159ede3708 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:05.674541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2a064-dbef-49b0-b031-3b159ede3708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-38d2a064-dbef-49b0-b031-3b159ede3708 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:05.679684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:05.680552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:05.682378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 169/342] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:05.687420 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2a064-dbef-49b0-b031-3b159ede3708 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:05.743821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 174/343] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:05.750246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:05.811759 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2a064-dbef-49b0-b031-3b159ede3708 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:05.825294 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114e644-77e4-4a7b-b275-8499db44ff4a None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:05.868586 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bbac3-f94e-44c9-9a3c-abeee051e640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:05.869217 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bbac3-f94e-44c9-9a3c-abeee051e640 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:05.869538 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bbac3-f94e-44c9-9a3c-abeee051e640 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:05.869812 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bbac3-f94e-44c9-9a3c-abeee051e640 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:05.870472 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bbac3-f94e-44c9-9a3c-abeee051e640 None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:05.870769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bbac3-f94e-44c9-9a3c-abeee051e640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:05.872139 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bbac3-f94e-44c9-9a3c-abeee051e640 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:05.881949 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 170/344] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:27:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:05.883145 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3667649-9f8f-4fa6-9559-16c34cbc7719 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:05.883426 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3667649-9f8f-4fa6-9559-16c34cbc7719 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:05.883839 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3667649-9f8f-4fa6-9559-16c34cbc7719 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:05.885461 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 171/345] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:05.888132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:05.889398 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3667649-9f8f-4fa6-9559-16c34cbc7719 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:05.979244 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114e644-77e4-4a7b-b275-8499db44ff4a None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:06.010262 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:06.024693 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3667649-9f8f-4fa6-9559-16c34cbc7719 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:06.025685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a590355-777e-40d8-b948-6a01e01dc846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:06.026570 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a590355-777e-40d8-b948-6a01e01dc846 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:06.027076 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a590355-777e-40d8-b948-6a01e01dc846 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:06.027557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a590355-777e-40d8-b948-6a01e01dc846 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:06.039603 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a590355-777e-40d8-b948-6a01e01dc846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-0a590355-777e-40d8-b948-6a01e01dc846 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:06.046062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:06.046937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:06.047707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:06.047707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:06.047707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:06.047707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:06.047707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:06.047707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:06.047707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:06.047707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:06.047707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:06.047707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:06.047707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:27:06.047707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:06.050172 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 175/346] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:06.051539 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acd7dc-a1bc-44c0-8276-1e646701d743 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:06.051991 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acd7dc-a1bc-44c0-8276-1e646701d743 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:06.052437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acd7dc-a1bc-44c0-8276-1e646701d743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:06.067077 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af090269-4b79-46c2-aa88-99fcf0a20017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:06.068262 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af090269-4b79-46c2-aa88-99fcf0a20017 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:06.068545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af090269-4b79-46c2-aa88-99fcf0a20017 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:06.068914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af090269-4b79-46c2-aa88-99fcf0a20017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:06.073493 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-c6acd7dc-a1bc-44c0-8276-1e646701d743 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:06.074973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-c6acd7dc-a1bc-44c0-8276-1e646701d743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:06.155622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af090269-4b79-46c2-aa88-99fcf0a20017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:06.157510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af090269-4b79-46c2-aa88-99fcf0a20017 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:06.162773 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 176/347] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:06.168395 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acd7dc-a1bc-44c0-8276-1e646701d743 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:06.216301 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:06.268544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:06.281660 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 172/348] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:06.288879 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af090269-4b79-46c2-aa88-99fcf0a20017 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:06.340549 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acd7dc-a1bc-44c0-8276-1e646701d743 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:06.386653 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5ace3-0be2-42e7-be11-bfeffe593d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:06.387864 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5ace3-0be2-42e7-be11-bfeffe593d78 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:06.388423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5ace3-0be2-42e7-be11-bfeffe593d78 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:06.389150 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5ace3-0be2-42e7-be11-bfeffe593d78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:06.403985 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5ace3-0be2-42e7-be11-bfeffe593d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:06.408217 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af090269-4b79-46c2-aa88-99fcf0a20017 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-daf5ace3-0be2-42e7-be11-bfeffe593d78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:06.411618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:06.412516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:06.413401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:06.413401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:06.413401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:06.413401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:06.413401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:06.413401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:06.413401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:06.413401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:06.413401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:06.413401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:06.413401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:27:06.413401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:06.423912 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 177/349] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:27:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:06.426091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5ace3-0be2-42e7-be11-bfeffe593d78 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:06.464565 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40a9f4-c0e8-4b72-b265-303e3ce4c990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:06.465229 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40a9f4-c0e8-4b72-b265-303e3ce4c990 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:06.465510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40a9f4-c0e8-4b72-b265-303e3ce4c990 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:06.465786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40a9f4-c0e8-4b72-b265-303e3ce4c990 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:06.466736 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40a9f4-c0e8-4b72-b265-303e3ce4c990 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:06.467042 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40a9f4-c0e8-4b72-b265-303e3ce4c990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:06.468416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40a9f4-c0e8-4b72-b265-303e3ce4c990 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:06.480800 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 173/350] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:27:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:06.480800 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40a9f4-c0e8-4b72-b265-303e3ce4c990 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:06.538203 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:06.549654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:06.562620 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5ace3-0be2-42e7-be11-bfeffe593d78 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:06.605248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dacf53-07cf-4f3e-8127-9da919a90601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:06.605890 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dacf53-07cf-4f3e-8127-9da919a90601 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:06.606169 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dacf53-07cf-4f3e-8127-9da919a90601 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:06.606440 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dacf53-07cf-4f3e-8127-9da919a90601 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:06.606840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40a9f4-c0e8-4b72-b265-303e3ce4c990 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:06.618249 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dacf53-07cf-4f3e-8127-9da919a90601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-22dacf53-07cf-4f3e-8127-9da919a90601 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:06.624588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:06.625536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:06.626336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 178/351] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:06.626988 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dacf53-07cf-4f3e-8127-9da919a90601 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:06.650518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a0be4-827c-49c7-9507-cb77dc38b16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:06.651160 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a0be4-827c-49c7-9507-cb77dc38b16f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:06.651606 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a0be4-827c-49c7-9507-cb77dc38b16f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:06.651890 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a0be4-827c-49c7-9507-cb77dc38b16f None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:06.653156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a0be4-827c-49c7-9507-cb77dc38b16f None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:06.654709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a0be4-827c-49c7-9507-cb77dc38b16f None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:06.656601 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 174/352] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:06 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:06.657882 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a0be4-827c-49c7-9507-cb77dc38b16f None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:06.754129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dacf53-07cf-4f3e-8127-9da919a90601 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:06.787134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a0be4-827c-49c7-9507-cb77dc38b16f None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:06.797829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53927ea7-99cc-4eb3-bfe4-7adfa71f8fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:06.798619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53927ea7-99cc-4eb3-bfe4-7adfa71f8fa0 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:06.798619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53927ea7-99cc-4eb3-bfe4-7adfa71f8fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:06.798886 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53927ea7-99cc-4eb3-bfe4-7adfa71f8fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:06.799562 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53927ea7-99cc-4eb3-bfe4-7adfa71f8fa0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:06.799863 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53927ea7-99cc-4eb3-bfe4-7adfa71f8fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:06.801303 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53927ea7-99cc-4eb3-bfe4-7adfa71f8fa0 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:06.810415 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 179/353] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:06.811404 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53927ea7-99cc-4eb3-bfe4-7adfa71f8fa0 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:06.814714 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:06.817030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:06.837574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9d125-d981-4f68-837b-9d670df93513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:06.838230 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9d125-d981-4f68-837b-9d670df93513 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:06.838513 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9d125-d981-4f68-837b-9d670df93513 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:06.838786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9d125-d981-4f68-837b-9d670df93513 None admin] PATH_INFO: `/v3/users/2876952f4f2e455b965d294b2f9b7e90` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:06.840210 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9d125-d981-4f68-837b-9d670df93513 None admin] RBAC: Authorizing `identity:get_user(user_id=2876952f4f2e455b965d294b2f9b7e90)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:06.842524 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9d125-d981-4f68-837b-9d670df93513 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:06.844613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 175/354] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 19 17:27:06 2022] GET /identity/v3/users/2876952f4f2e455b965d294b2f9b7e90 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:06.845860 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9d125-d981-4f68-837b-9d670df93513 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:06.927099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53927ea7-99cc-4eb3-bfe4-7adfa71f8fa0 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:06.963846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefc9a5-9bb9-4dc7-9340-a3e3104ca873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:06.964479 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefc9a5-9bb9-4dc7-9340-a3e3104ca873 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:06.964781 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefc9a5-9bb9-4dc7-9340-a3e3104ca873 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:06.965055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefc9a5-9bb9-4dc7-9340-a3e3104ca873 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:06.977605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefc9a5-9bb9-4dc7-9340-a3e3104ca873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:06.977839 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9d125-d981-4f68-837b-9d670df93513 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-cfefc9a5-9bb9-4dc7-9340-a3e3104ca873 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:06.983494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:06.984708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:06.985576 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 180/355] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:27:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:06.986305 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefc9a5-9bb9-4dc7-9340-a3e3104ca873 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:07.021152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7411989-7d02-41de-8860-d11d2307e1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:07.021765 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7411989-7d02-41de-8860-d11d2307e1a0 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:07.022047 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7411989-7d02-41de-8860-d11d2307e1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:07.022322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7411989-7d02-41de-8860-d11d2307e1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:07.022982 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7411989-7d02-41de-8860-d11d2307e1a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:07.023352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7411989-7d02-41de-8860-d11d2307e1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:07.024785 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7411989-7d02-41de-8860-d11d2307e1a0 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:07.034344 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 176/356] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:27:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:07.034986 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7411989-7d02-41de-8860-d11d2307e1a0 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:07.059538 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:07.098179 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:07.105517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefc9a5-9bb9-4dc7-9340-a3e3104ca873 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:07.144229 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949c9aa-fcad-412b-8431-8140df464346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:07.145279 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949c9aa-fcad-412b-8431-8140df464346 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:07.145562 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949c9aa-fcad-412b-8431-8140df464346 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:07.145835 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949c9aa-fcad-412b-8431-8140df464346 None admin] PATH_INFO: `/v3/groups/40d2d769c46d43119cd24be7997da2a8` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:07.154041 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949c9aa-fcad-412b-8431-8140df464346 None admin] RBAC: Authorizing `identity:get_group(group_id=40d2d769c46d43119cd24be7997da2a8)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:07.155555 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949c9aa-fcad-412b-8431-8140df464346 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:07.157374 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 181/357] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:06 2022] GET /identity/v3/groups/40d2d769c46d43119cd24be7997da2a8 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:07.157696 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7411989-7d02-41de-8860-d11d2307e1a0 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:07.158376 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8c2ee-2526-4187-b3f8-5013572f68e9 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:07.158661 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8c2ee-2526-4187-b3f8-5013572f68e9 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:07.158938 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8c2ee-2526-4187-b3f8-5013572f68e9 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:07.160133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 182/358] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:07.160865 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8c2ee-2526-4187-b3f8-5013572f68e9 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:07.200279 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa317231-bbab-4744-92e0-0e63e81444a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:07.200949 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa317231-bbab-4744-92e0-0e63e81444a2 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:07.201229 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa317231-bbab-4744-92e0-0e63e81444a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:07.202413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa317231-bbab-4744-92e0-0e63e81444a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:07.282624 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8c2ee-2526-4187-b3f8-5013572f68e9 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:07.287392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa317231-bbab-4744-92e0-0e63e81444a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:07.288893 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa317231-bbab-4744-92e0-0e63e81444a2 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:07.313105 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:07.326329 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763ed05-e95e-4379-b003-bc5469446965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:07.327022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763ed05-e95e-4379-b003-bc5469446965 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:07.327300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763ed05-e95e-4379-b003-bc5469446965 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:07.327569 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763ed05-e95e-4379-b003-bc5469446965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:07.328299 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763ed05-e95e-4379-b003-bc5469446965 None admin] RBAC: Adding query filter params (role.id=783aa30fbf304861957e0d234b935acf, user.id=2876952f4f2e455b965d294b2f9b7e90, scope.system=all) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:07.328600 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763ed05-e95e-4379-b003-bc5469446965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:07.330201 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763ed05-e95e-4379-b003-bc5469446965 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:07.348277 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 183/359] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Aug 19 17:27:07 2022] GET /identity/v3/role_assignments?user.id=2876952f4f2e455b965d294b2f9b7e90&scope.system=all&role.id=783aa30fbf304861957e0d234b935acf => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:07.348277 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763ed05-e95e-4379-b003-bc5469446965 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:07.358834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:07.460237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 177/360] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:07.460237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa317231-bbab-4744-92e0-0e63e81444a2 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:07.499779 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763ed05-e95e-4379-b003-bc5469446965 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:07.549308 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4185de-1d86-45a9-8157-2afd36a14266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:07.550086 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4185de-1d86-45a9-8157-2afd36a14266 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:07.550371 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4185de-1d86-45a9-8157-2afd36a14266 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:07.551161 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4185de-1d86-45a9-8157-2afd36a14266 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:07.551835 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4185de-1d86-45a9-8157-2afd36a14266 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:07.552436 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4185de-1d86-45a9-8157-2afd36a14266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:07.555146 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4185de-1d86-45a9-8157-2afd36a14266 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:07.566037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 184/361] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:07.566795 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4185de-1d86-45a9-8157-2afd36a14266 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:07.600464 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa317231-bbab-4744-92e0-0e63e81444a2 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:07.627644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:07.639921 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ec3db-969a-4ea1-997d-152910d57474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:07.647931 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ec3db-969a-4ea1-997d-152910d57474 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:07.647931 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ec3db-969a-4ea1-997d-152910d57474 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:07.647931 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ec3db-969a-4ea1-997d-152910d57474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:07.664219 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:07.691303 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4185de-1d86-45a9-8157-2afd36a14266 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:07.721988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ec3db-969a-4ea1-997d-152910d57474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:07.724497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ec3db-969a-4ea1-997d-152910d57474 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:07.737020 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe4401-a6f8-444b-8103-9d90b057c4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:07.737629 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe4401-a6f8-444b-8103-9d90b057c4e3 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:07.737907 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe4401-a6f8-444b-8103-9d90b057c4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:07.738177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe4401-a6f8-444b-8103-9d90b057c4e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:07.738957 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe4401-a6f8-444b-8103-9d90b057c4e3 None admin] RBAC: Adding query filter params (group.id=40d2d769c46d43119cd24be7997da2a8, role.id=f81ebe87e8a74c24a390dbaafdacdbce, scope.project.id=1819a9eb8b794d41999ed4c6e858aa28) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:07.739263 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe4401-a6f8-444b-8103-9d90b057c4e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:07.740749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe4401-a6f8-444b-8103-9d90b057c4e3 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:07.747289 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 185/362] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 19 17:27:07 2022] GET /identity/v3/role_assignments?group.id=40d2d769c46d43119cd24be7997da2a8&scope.project.id=1819a9eb8b794d41999ed4c6e858aa28&role.id=f81ebe87e8a74c24a390dbaafdacdbce => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:07.748765 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f342fa6-2790-4006-a0e4-da0ce51aff95 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:07.749063 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f342fa6-2790-4006-a0e4-da0ce51aff95 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:07.749344 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f342fa6-2790-4006-a0e4-da0ce51aff95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:07.772317 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-2f342fa6-2790-4006-a0e4-da0ce51aff95 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:07.773684 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-2f342fa6-2790-4006-a0e4-da0ce51aff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:07.870295 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 178/363] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:07.871048 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ec3db-969a-4ea1-997d-152910d57474 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:07.889262 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 186/364] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:07.891484 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f342fa6-2790-4006-a0e4-da0ce51aff95 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:07.948561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:07.950915 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:08.026704 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ec3db-969a-4ea1-997d-152910d57474 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:08.028395 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f342fa6-2790-4006-a0e4-da0ce51aff95 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:08.070392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6982ef1-98f1-4212-8f27-f35219c9e8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:08.071570 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6982ef1-98f1-4212-8f27-f35219c9e8ed None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:08.072595 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6982ef1-98f1-4212-8f27-f35219c9e8ed None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:08.072925 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bba514-d5f4-4fbc-b3f8-929633bd5253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:08.073273 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6982ef1-98f1-4212-8f27-f35219c9e8ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:08.073682 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bba514-d5f4-4fbc-b3f8-929633bd5253 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:08.074026 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bba514-d5f4-4fbc-b3f8-929633bd5253 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:08.074359 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bba514-d5f4-4fbc-b3f8-929633bd5253 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:08.075516 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bba514-d5f4-4fbc-b3f8-929633bd5253 None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:08.077224 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bba514-d5f4-4fbc-b3f8-929633bd5253 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:08.079430 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 179/365] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:07 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:08.080138 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bba514-d5f4-4fbc-b3f8-929633bd5253 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:08.162338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6982ef1-98f1-4212-8f27-f35219c9e8ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:08.164338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6982ef1-98f1-4212-8f27-f35219c9e8ed None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:08.209608 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bba514-d5f4-4fbc-b3f8-929633bd5253 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:08.222612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:08.239135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:08.255648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22bfb7-c717-4b1e-8466-29c8c7a6450a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:08.256666 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22bfb7-c717-4b1e-8466-29c8c7a6450a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:08.257295 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22bfb7-c717-4b1e-8466-29c8c7a6450a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:08.257809 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22bfb7-c717-4b1e-8466-29c8c7a6450a None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:08.259216 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22bfb7-c717-4b1e-8466-29c8c7a6450a None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:08.262717 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22bfb7-c717-4b1e-8466-29c8c7a6450a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:08.265262 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 180/366] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:08 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:08.266278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22bfb7-c717-4b1e-8466-29c8c7a6450a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:08.298382 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 187/367] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:08.299235 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6982ef1-98f1-4212-8f27-f35219c9e8ed None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:08.405027 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22bfb7-c717-4b1e-8466-29c8c7a6450a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:08.422754 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6982ef1-98f1-4212-8f27-f35219c9e8ed None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:08.450497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6aedf-9531-4b40-a09a-872fa7d49907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:08.450497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6aedf-9531-4b40-a09a-872fa7d49907 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:08.450759 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6aedf-9531-4b40-a09a-872fa7d49907 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:08.450981 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6aedf-9531-4b40-a09a-872fa7d49907 None admin] PATH_INFO: `/v3/groups/40d2d769c46d43119cd24be7997da2a8` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:08.453413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6aedf-9531-4b40-a09a-872fa7d49907 None admin] RBAC: Authorizing `identity:get_group(group_id=40d2d769c46d43119cd24be7997da2a8)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:08.454889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee6aedf-9531-4b40-a09a-872fa7d49907 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:08.456490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 181/368] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:08 2022] GET /identity/v3/groups/40d2d769c46d43119cd24be7997da2a8 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:08.457281 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6aedf-9531-4b40-a09a-872fa7d49907 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:08.469437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374db2d-48c3-4851-8ce4-2b1eff5eeadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:08.470514 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374db2d-48c3-4851-8ce4-2b1eff5eeadc None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:08.470984 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374db2d-48c3-4851-8ce4-2b1eff5eeadc None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:08.471390 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374db2d-48c3-4851-8ce4-2b1eff5eeadc None admin] PATH_INFO: `/v3/groups/40d2d769c46d43119cd24be7997da2a8` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:08.473320 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374db2d-48c3-4851-8ce4-2b1eff5eeadc None admin] RBAC: Authorizing `identity:get_group(group_id=40d2d769c46d43119cd24be7997da2a8)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:08.475009 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374db2d-48c3-4851-8ce4-2b1eff5eeadc None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:08.476842 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 188/369] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:08 2022] GET /identity/v3/groups/40d2d769c46d43119cd24be7997da2a8 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:08.478604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374db2d-48c3-4851-8ce4-2b1eff5eeadc None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:08.490784 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:08.527628 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:08.584178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6aedf-9531-4b40-a09a-872fa7d49907 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:08.609993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374db2d-48c3-4851-8ce4-2b1eff5eeadc None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:08.624586 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb2d84-2d7c-4a7e-bfae-26d4b4ba9b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:08.625257 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2d84-2d7c-4a7e-bfae-26d4b4ba9b1c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:08.625533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2d84-2d7c-4a7e-bfae-26d4b4ba9b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:08.625804 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb2d84-2d7c-4a7e-bfae-26d4b4ba9b1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:08.636268 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb2d84-2d7c-4a7e-bfae-26d4b4ba9b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-4ccb2d84-2d7c-4a7e-bfae-26d4b4ba9b1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:08.641386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:08.642246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 182/370] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:27:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:08.643687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb2d84-2d7c-4a7e-bfae-26d4b4ba9b1c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:08.651095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdbbf2-c0d0-47ab-a2e7-82a5f30e6533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:08.651722 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdbbf2-c0d0-47ab-a2e7-82a5f30e6533 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:08.652002 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdbbf2-c0d0-47ab-a2e7-82a5f30e6533 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:08.652272 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdbbf2-c0d0-47ab-a2e7-82a5f30e6533 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:08.653500 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdbbf2-c0d0-47ab-a2e7-82a5f30e6533 None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:08.655095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdbbf2-c0d0-47ab-a2e7-82a5f30e6533 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:08.656682 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 189/371] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:08 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:08.657352 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdbbf2-c0d0-47ab-a2e7-82a5f30e6533 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:08.742487 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:08.756206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb2d84-2d7c-4a7e-bfae-26d4b4ba9b1c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:08.765137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdbbf2-c0d0-47ab-a2e7-82a5f30e6533 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:08.777574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:08.798083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cdf2d-21d0-4c0c-bc0e-d7922ed958a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:08.798686 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cdf2d-21d0-4c0c-bc0e-d7922ed958a3 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:08.798962 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cdf2d-21d0-4c0c-bc0e-d7922ed958a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:08.799237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cdf2d-21d0-4c0c-bc0e-d7922ed958a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:08.799960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cdf2d-21d0-4c0c-bc0e-d7922ed958a3 None admin] RBAC: Adding query filter params (group.id=40d2d769c46d43119cd24be7997da2a8, role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1, scope.project.id=1819a9eb8b794d41999ed4c6e858aa28) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:08.800359 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cdf2d-21d0-4c0c-bc0e-d7922ed958a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:08.801838 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cdf2d-21d0-4c0c-bc0e-d7922ed958a3 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:08.801957 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06a4c1-af92-4ec5-a86b-d4a8db4f8ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:08.802528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06a4c1-af92-4ec5-a86b-d4a8db4f8ff5 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:08.802801 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06a4c1-af92-4ec5-a86b-d4a8db4f8ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:08.803065 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06a4c1-af92-4ec5-a86b-d4a8db4f8ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:08.803774 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06a4c1-af92-4ec5-a86b-d4a8db4f8ff5 None admin] RBAC: Adding query filter params (group.id=40d2d769c46d43119cd24be7997da2a8, role.id=f81ebe87e8a74c24a390dbaafdacdbce, scope.project.id=1eaaf654aca040a7bc85be7d785887be) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:08.804074 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06a4c1-af92-4ec5-a86b-d4a8db4f8ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:08.805659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06a4c1-af92-4ec5-a86b-d4a8db4f8ff5 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:08.818666 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 190/372] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 19 17:27:08 2022] GET /identity/v3/role_assignments?group.id=40d2d769c46d43119cd24be7997da2a8&scope.project.id=1eaaf654aca040a7bc85be7d785887be&role.id=f81ebe87e8a74c24a390dbaafdacdbce => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:08.818666 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06a4c1-af92-4ec5-a86b-d4a8db4f8ff5 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:08.818914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 183/373] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 19 17:27:08 2022] GET /identity/v3/role_assignments?group.id=40d2d769c46d43119cd24be7997da2a8&scope.project.id=1819a9eb8b794d41999ed4c6e858aa28&role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:08.818914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cdf2d-21d0-4c0c-bc0e-d7922ed958a3 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:09.018152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cdf2d-21d0-4c0c-bc0e-d7922ed958a3 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:09.041067 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06a4c1-af92-4ec5-a86b-d4a8db4f8ff5 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:09.071401 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e1ddc-7769-4c48-b862-0582b365660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:09.072612 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e1ddc-7769-4c48-b862-0582b365660a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:09.072875 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e1ddc-7769-4c48-b862-0582b365660a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:09.073148 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e1ddc-7769-4c48-b862-0582b365660a None admin] PATH_INFO: `/v3/groups/40d2d769c46d43119cd24be7997da2a8` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:09.074262 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e1ddc-7769-4c48-b862-0582b365660a None admin] RBAC: Authorizing `identity:get_group(group_id=40d2d769c46d43119cd24be7997da2a8)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:09.075690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e1ddc-7769-4c48-b862-0582b365660a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:09.077455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 184/374] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:08 2022] GET /identity/v3/groups/40d2d769c46d43119cd24be7997da2a8 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:09.083475 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e1ddc-7769-4c48-b862-0582b365660a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:09.091361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed757fb3-b6b4-4eb1-bc91-db45516a4fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:09.091983 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757fb3-b6b4-4eb1-bc91-db45516a4fa6 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:09.092247 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757fb3-b6b4-4eb1-bc91-db45516a4fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:09.092521 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757fb3-b6b4-4eb1-bc91-db45516a4fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:09.093211 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed757fb3-b6b4-4eb1-bc91-db45516a4fa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:09.093512 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed757fb3-b6b4-4eb1-bc91-db45516a4fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:09.095803 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed757fb3-b6b4-4eb1-bc91-db45516a4fa6 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:09.114992 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 191/375] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:09.121858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed757fb3-b6b4-4eb1-bc91-db45516a4fa6 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:09.139862 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:09.155898 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:09.229175 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e1ddc-7769-4c48-b862-0582b365660a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:09.268278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc750e2-b96f-4edc-8f08-d9bffd7476be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:09.269256 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc750e2-b96f-4edc-8f08-d9bffd7476be None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:09.269740 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc750e2-b96f-4edc-8f08-d9bffd7476be None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:09.270511 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc750e2-b96f-4edc-8f08-d9bffd7476be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:09.271908 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc750e2-b96f-4edc-8f08-d9bffd7476be None admin] RBAC: Adding query filter params (group.id=40d2d769c46d43119cd24be7997da2a8, role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1, scope.project.id=1eaaf654aca040a7bc85be7d785887be) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:09.272451 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc750e2-b96f-4edc-8f08-d9bffd7476be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:09.274722 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc750e2-b96f-4edc-8f08-d9bffd7476be None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:09.282206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 185/376] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 19 17:27:09 2022] GET /identity/v3/role_assignments?group.id=40d2d769c46d43119cd24be7997da2a8&scope.project.id=1eaaf654aca040a7bc85be7d785887be&role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:09.313326 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed757fb3-b6b4-4eb1-bc91-db45516a4fa6 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:09.375400 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eccb26-c8c5-410f-9801-9ae46f9f439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:09.376012 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eccb26-c8c5-410f-9801-9ae46f9f439c None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:09.376336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eccb26-c8c5-410f-9801-9ae46f9f439c None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:09.376608 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eccb26-c8c5-410f-9801-9ae46f9f439c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:09.535778 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eccb26-c8c5-410f-9801-9ae46f9f439c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:09.537213 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eccb26-c8c5-410f-9801-9ae46f9f439c None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:09.539392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:09.663108 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 192/377] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:09.669017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc750e2-b96f-4edc-8f08-d9bffd7476be None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:09.823004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc750e2-b96f-4edc-8f08-d9bffd7476be None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:09.839321 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:09.869174 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd57483-037b-46c2-9a9c-4a0a9bb76a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:09.869819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd57483-037b-46c2-9a9c-4a0a9bb76a3f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:09.870093 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd57483-037b-46c2-9a9c-4a0a9bb76a3f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:09.870359 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd57483-037b-46c2-9a9c-4a0a9bb76a3f None admin] PATH_INFO: `/v3/projects/72d7a88be3624749bd4e592197eaa598` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:09.871484 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd57483-037b-46c2-9a9c-4a0a9bb76a3f None admin] RBAC: Authorizing `identity:get_project(project_id=72d7a88be3624749bd4e592197eaa598)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:09.872943 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd57483-037b-46c2-9a9c-4a0a9bb76a3f None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:09.875155 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 186/378] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:09 2022] GET /identity/v3/projects/72d7a88be3624749bd4e592197eaa598 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:09.880209 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eccb26-c8c5-410f-9801-9ae46f9f439c None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:10.009629 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eccb26-c8c5-410f-9801-9ae46f9f439c None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:10.011469 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:10.060167 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0581ae-8628-49ee-9ae5-7ce7fe5fb2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:10.060801 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0581ae-8628-49ee-9ae5-7ce7fe5fb2c0 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:10.061084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0581ae-8628-49ee-9ae5-7ce7fe5fb2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:10.061356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0581ae-8628-49ee-9ae5-7ce7fe5fb2c0 None admin] PATH_INFO: `/v3/groups/7539d1867156477982468c2a43dcaa23` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:10.066392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0581ae-8628-49ee-9ae5-7ce7fe5fb2c0 None admin] RBAC: Authorizing `identity:get_group(group_id=7539d1867156477982468c2a43dcaa23)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:10.067855 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0581ae-8628-49ee-9ae5-7ce7fe5fb2c0 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:10.069746 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 193/379] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:09 2022] GET /identity/v3/groups/7539d1867156477982468c2a43dcaa23 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:10.075395 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd57483-037b-46c2-9a9c-4a0a9bb76a3f None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:10.229127 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd57483-037b-46c2-9a9c-4a0a9bb76a3f None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:10.263926 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc744e-2377-4d84-8b19-41c97d9a5329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:10.264527 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc744e-2377-4d84-8b19-41c97d9a5329 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:10.264832 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc744e-2377-4d84-8b19-41c97d9a5329 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:10.265104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc744e-2377-4d84-8b19-41c97d9a5329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:10.265821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc744e-2377-4d84-8b19-41c97d9a5329 None admin] RBAC: Adding query filter params (group.id=7539d1867156477982468c2a43dcaa23, role.id=17791940429e48ac98d4bd49aa53a88c, scope.project.id=72d7a88be3624749bd4e592197eaa598) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:10.266169 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc744e-2377-4d84-8b19-41c97d9a5329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:10.267597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc744e-2377-4d84-8b19-41c97d9a5329 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:10.273511 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 187/380] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 19 17:27:10 2022] GET /identity/v3/role_assignments?group.id=7539d1867156477982468c2a43dcaa23&scope.project.id=72d7a88be3624749bd4e592197eaa598&role.id=17791940429e48ac98d4bd49aa53a88c => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:10.362716 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24afc8-d6ed-4977-b39e-4320491af7df None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:10.363082 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24afc8-d6ed-4977-b39e-4320491af7df None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:10.363455 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24afc8-d6ed-4977-b39e-4320491af7df None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:10.365269 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 194/381] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:10.371398 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f5547-3a8b-40cb-aecd-a04bf6a709dd None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:10.371799 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f5547-3a8b-40cb-aecd-a04bf6a709dd None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:10.372081 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f5547-3a8b-40cb-aecd-a04bf6a709dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:10.392198 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-f94f5547-3a8b-40cb-aecd-a04bf6a709dd None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:10.393402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-f94f5547-3a8b-40cb-aecd-a04bf6a709dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:10.467615 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:10.501539 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 188/382] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:10.909196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24afc8-d6ed-4977-b39e-4320491af7df None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:11.019411 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24afc8-d6ed-4977-b39e-4320491af7df None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:11.066567 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8dcc1-00f3-4853-a5a9-582ef10daac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:11.067228 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8dcc1-00f3-4853-a5a9-582ef10daac4 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:11.067469 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8dcc1-00f3-4853-a5a9-582ef10daac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:11.067744 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8dcc1-00f3-4853-a5a9-582ef10daac4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:11.089314 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8dcc1-00f3-4853-a5a9-582ef10daac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-3da8dcc1-00f3-4853-a5a9-582ef10daac4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:11.094196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:11.095051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:11.096226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 195/383] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:11.101156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f5547-3a8b-40cb-aecd-a04bf6a709dd None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:11.231142 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f5547-3a8b-40cb-aecd-a04bf6a709dd None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:11.277801 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd64bab-c369-49cf-86da-f5e10ff8e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:11.278415 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64bab-c369-49cf-86da-f5e10ff8e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:11.278697 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64bab-c369-49cf-86da-f5e10ff8e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:11.278972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64bab-c369-49cf-86da-f5e10ff8e7e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:11.279636 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd64bab-c369-49cf-86da-f5e10ff8e7e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:11.279940 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd64bab-c369-49cf-86da-f5e10ff8e7e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:11.281354 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd64bab-c369-49cf-86da-f5e10ff8e7e1 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:11.293457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 189/384] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:27:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:11.299271 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8dcc1-00f3-4853-a5a9-582ef10daac4 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:11.329307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:11.416801 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8dcc1-00f3-4853-a5a9-582ef10daac4 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:11.459266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8141d-f222-417f-9736-fb67a0319a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:11.459903 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8141d-f222-417f-9736-fb67a0319a82 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:11.460181 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8141d-f222-417f-9736-fb67a0319a82 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:11.460449 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8141d-f222-417f-9736-fb67a0319a82 None admin] PATH_INFO: `/v3/groups/40d2d769c46d43119cd24be7997da2a8` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:11.465385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8141d-f222-417f-9736-fb67a0319a82 None admin] RBAC: Authorizing `identity:get_group(group_id=40d2d769c46d43119cd24be7997da2a8)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:11.466831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8141d-f222-417f-9736-fb67a0319a82 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:11.468481 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 196/385] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:11 2022] GET /identity/v3/groups/40d2d769c46d43119cd24be7997da2a8 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:11.474101 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd64bab-c369-49cf-86da-f5e10ff8e7e1 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:11.533726 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:11.568526 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1464ed-cde3-4ad7-97ae-bcea99cb3c5b None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:11.568835 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1464ed-cde3-4ad7-97ae-bcea99cb3c5b None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:11.569098 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1464ed-cde3-4ad7-97ae-bcea99cb3c5b None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:11.570423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 197/386] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:27:11.576038 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab2140-5abc-4872-a86d-4e743280c1eb None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:11.576311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab2140-5abc-4872-a86d-4e743280c1eb None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:11.576581 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab2140-5abc-4872-a86d-4e743280c1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:11.602666 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-e2ab2140-5abc-4872-a86d-4e743280c1eb None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:11.603935 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-e2ab2140-5abc-4872-a86d-4e743280c1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:11.627834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd64bab-c369-49cf-86da-f5e10ff8e7e1 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:11.675821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 198/387] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 19 17:27:11.677238 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa68403-7034-4e0c-b433-3d7b703ba83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:11.677707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a118c6-f178-4d40-a003-12c9d1710602 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:11.677871 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa68403-7034-4e0c-b433-3d7b703ba83a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:11.678346 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa68403-7034-4e0c-b433-3d7b703ba83a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:11.678563 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a118c6-f178-4d40-a003-12c9d1710602 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:11.678673 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa68403-7034-4e0c-b433-3d7b703ba83a None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:11.679074 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a118c6-f178-4d40-a003-12c9d1710602 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:11.680321 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa68403-7034-4e0c-b433-3d7b703ba83a None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:11.680569 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 199/388] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:11.686146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa68403-7034-4e0c-b433-3d7b703ba83a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:11.688312 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 190/389] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:11 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:11.690157 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6bb58-13b8-4b5a-84e8-1568ea568568 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:11.690618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6bb58-13b8-4b5a-84e8-1568ea568568 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:11.691058 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6bb58-13b8-4b5a-84e8-1568ea568568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:11.693784 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa68403-7034-4e0c-b433-3d7b703ba83a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:11.719889 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-0af6bb58-13b8-4b5a-84e8-1568ea568568 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:11.721485 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-0af6bb58-13b8-4b5a-84e8-1568ea568568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:11.741055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:11.800055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 200/390] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:11.864427 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa68403-7034-4e0c-b433-3d7b703ba83a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:11.866808 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:11.922214 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589910f-29b8-4ae8-b51a-bad938c5745c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:11.922417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589910f-29b8-4ae8-b51a-bad938c5745c None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:11.922599 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589910f-29b8-4ae8-b51a-bad938c5745c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:11.922841 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589910f-29b8-4ae8-b51a-bad938c5745c None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28/groups/40d2d769c46d43119cd24be7997da2a8/roles/f81ebe87e8a74c24a390dbaafdacdbce` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:11.924814 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589910f-29b8-4ae8-b51a-bad938c5745c None admin] RBAC: Authorizing `identity:create_grant(project_id=1819a9eb8b794d41999ed4c6e858aa28, group_id=40d2d769c46d43119cd24be7997da2a8, role_id=f81ebe87e8a74c24a390dbaafdacdbce)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:11.926269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589910f-29b8-4ae8-b51a-bad938c5745c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:12.040378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 191/391] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 19 17:27:11 2022] PUT /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28/groups/40d2d769c46d43119cd24be7997da2a8/roles/f81ebe87e8a74c24a390dbaafdacdbce => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 17:27:12.161835 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6bb58-13b8-4b5a-84e8-1568ea568568 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:12.173743 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d01de3-9e93-457a-8f4a-afa809099925 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:12.174634 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d01de3-9e93-457a-8f4a-afa809099925 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:12.175156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d01de3-9e93-457a-8f4a-afa809099925 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:12.177126 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 192/392] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:12.192166 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83adf5-ba17-454c-85a3-d721b245308a None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:12.192855 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83adf5-ba17-454c-85a3-d721b245308a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:12.193407 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83adf5-ba17-454c-85a3-d721b245308a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:12.229829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-2e83adf5-ba17-454c-85a3-d721b245308a None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:12.231137 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-2e83adf5-ba17-454c-85a3-d721b245308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:12.286939 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6bb58-13b8-4b5a-84e8-1568ea568568 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:12.326247 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099775-5995-4e8c-80c1-a6bb5cc9c75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:12.326870 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099775-5995-4e8c-80c1-a6bb5cc9c75d None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:12.327143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099775-5995-4e8c-80c1-a6bb5cc9c75d None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:12.327408 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099775-5995-4e8c-80c1-a6bb5cc9c75d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:12.331327 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 193/393] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:12.332000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83adf5-ba17-454c-85a3-d721b245308a None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:12.345880 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099775-5995-4e8c-80c1-a6bb5cc9c75d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-56099775-5995-4e8c-80c1-a6bb5cc9c75d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:12.352655 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:12.354248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:12.355031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:12.355031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:12.355031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:12.355031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:12.355031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:12.355031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:12.355031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:12.355031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:12.355031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:12.355031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:12.355031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:27:12.355031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:12.358388 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 201/394] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:27:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:12.364710 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099775-5995-4e8c-80c1-a6bb5cc9c75d None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:12.401073 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:12.483164 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:12.501023 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83adf5-ba17-454c-85a3-d721b245308a None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:12.525642 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099775-5995-4e8c-80c1-a6bb5cc9c75d None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:12.572344 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279f344-0fbb-46ea-a57d-b7301e945f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:12.573006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f344-0fbb-46ea-a57d-b7301e945f77 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:12.573245 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f344-0fbb-46ea-a57d-b7301e945f77 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:12.573608 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f344-0fbb-46ea-a57d-b7301e945f77 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:12.574280 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279f344-0fbb-46ea-a57d-b7301e945f77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:12.574577 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279f344-0fbb-46ea-a57d-b7301e945f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:12.575953 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279f344-0fbb-46ea-a57d-b7301e945f77 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:12.577504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d485ac1-66c7-41a9-9993-075a40b8bf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:12.578448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d485ac1-66c7-41a9-9993-075a40b8bf0d None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:12.578911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d485ac1-66c7-41a9-9993-075a40b8bf0d None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:12.579362 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d485ac1-66c7-41a9-9993-075a40b8bf0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:12.589097 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 202/395] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:12.591223 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279f344-0fbb-46ea-a57d-b7301e945f77 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:12.605733 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d485ac1-66c7-41a9-9993-075a40b8bf0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-7d485ac1-66c7-41a9-9993-075a40b8bf0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:12.614994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:12.615936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:12.616786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 194/396] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:12.623727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d485ac1-66c7-41a9-9993-075a40b8bf0d None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:12.673725 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:12.694811 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279f344-0fbb-46ea-a57d-b7301e945f77 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:12.746787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3818c1c-90c7-47f9-853b-258095634541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:12.747514 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3818c1c-90c7-47f9-853b-258095634541 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:12.747700 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3818c1c-90c7-47f9-853b-258095634541 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:12.747962 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3818c1c-90c7-47f9-853b-258095634541 None admin] PATH_INFO: `/v3/groups/40d2d769c46d43119cd24be7997da2a8` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:12.753441 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3818c1c-90c7-47f9-853b-258095634541 None admin] RBAC: Authorizing `identity:get_group(group_id=40d2d769c46d43119cd24be7997da2a8)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:12.754910 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3818c1c-90c7-47f9-853b-258095634541 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:12.757096 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 203/397] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:12 2022] GET /identity/v3/groups/40d2d769c46d43119cd24be7997da2a8 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:12.762634 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3818c1c-90c7-47f9-853b-258095634541 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:12.765097 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d485ac1-66c7-41a9-9993-075a40b8bf0d None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:12.824553 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea571b92-04a4-4704-b94f-0cb703172b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:12.825360 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea571b92-04a4-4704-b94f-0cb703172b00 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:12.825654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea571b92-04a4-4704-b94f-0cb703172b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:12.825919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea571b92-04a4-4704-b94f-0cb703172b00 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:12.826589 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea571b92-04a4-4704-b94f-0cb703172b00 None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:12.826895 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea571b92-04a4-4704-b94f-0cb703172b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:12.828389 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea571b92-04a4-4704-b94f-0cb703172b00 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:12.843060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 195/398] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:27:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:12.844040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea571b92-04a4-4704-b94f-0cb703172b00 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:12.874838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3818c1c-90c7-47f9-853b-258095634541 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:12.880936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:12.912231 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4f075-014c-4094-b010-2d255c18d744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:12.912898 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4f075-014c-4094-b010-2d255c18d744 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:12.913177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4f075-014c-4094-b010-2d255c18d744 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:12.913446 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4f075-014c-4094-b010-2d255c18d744 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:12.914653 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4f075-014c-4094-b010-2d255c18d744 None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:12.920174 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4f075-014c-4094-b010-2d255c18d744 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:12.922494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 204/399] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:12 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:12.923394 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4f075-014c-4094-b010-2d255c18d744 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:12.943361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:12.955532 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea571b92-04a4-4704-b94f-0cb703172b00 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:12.992158 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fe8e4-6dd0-4927-8242-596e8d23e95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:12.992820 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fe8e4-6dd0-4927-8242-596e8d23e95c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:12.993101 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fe8e4-6dd0-4927-8242-596e8d23e95c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:12.993372 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fe8e4-6dd0-4927-8242-596e8d23e95c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:13.004253 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fe8e4-6dd0-4927-8242-596e8d23e95c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-3b0fe8e4-6dd0-4927-8242-596e8d23e95c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:13.009957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:13.010853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:13.011661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 196/400] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:27:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:13.013092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fe8e4-6dd0-4927-8242-596e8d23e95c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:13.039762 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4f075-014c-4094-b010-2d255c18d744 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:13.078727 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891a719-9ed8-4c8c-88ce-83b03e8304ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:13.082708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891a719-9ed8-4c8c-88ce-83b03e8304ab None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:13.082708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891a719-9ed8-4c8c-88ce-83b03e8304ab None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:13.082708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891a719-9ed8-4c8c-88ce-83b03e8304ab None admin] PATH_INFO: `/v3/groups/40d2d769c46d43119cd24be7997da2a8` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:13.082708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891a719-9ed8-4c8c-88ce-83b03e8304ab None admin] RBAC: Authorizing `identity:get_group(group_id=40d2d769c46d43119cd24be7997da2a8)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:13.082708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891a719-9ed8-4c8c-88ce-83b03e8304ab None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:13.084793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 205/401] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:12 2022] GET /identity/v3/groups/40d2d769c46d43119cd24be7997da2a8 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:13.090115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a4150-067c-4e07-8d25-701478d4a096 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:13.090115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a4150-067c-4e07-8d25-701478d4a096 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:13.090115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a4150-067c-4e07-8d25-701478d4a096 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:13.092159 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 206/402] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:13.092937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a4150-067c-4e07-8d25-701478d4a096 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:13.098705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:13.122300 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fe8e4-6dd0-4927-8242-596e8d23e95c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:13.160255 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6965a3-06ee-4766-9651-eaa427e2ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:13.161481 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6965a3-06ee-4766-9651-eaa427e2ddee None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:13.161922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6965a3-06ee-4766-9651-eaa427e2ddee None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:13.162200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6965a3-06ee-4766-9651-eaa427e2ddee None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28/groups/40d2d769c46d43119cd24be7997da2a8/roles/d7e1e74a1b2f48319ddb2eadb4ffa9a1` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:13.164393 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6965a3-06ee-4766-9651-eaa427e2ddee None admin] RBAC: Authorizing `identity:create_grant(project_id=1819a9eb8b794d41999ed4c6e858aa28, group_id=40d2d769c46d43119cd24be7997da2a8, role_id=d7e1e74a1b2f48319ddb2eadb4ffa9a1)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:13.165955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6965a3-06ee-4766-9651-eaa427e2ddee None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:13.187056 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:13.206909 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a4150-067c-4e07-8d25-701478d4a096 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:13.239630 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48a126-aeb2-4161-8c18-90b692796510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:13.240289 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48a126-aeb2-4161-8c18-90b692796510 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:13.240804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48a126-aeb2-4161-8c18-90b692796510 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:13.241081 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48a126-aeb2-4161-8c18-90b692796510 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:13.241735 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48a126-aeb2-4161-8c18-90b692796510 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:13.242040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48a126-aeb2-4161-8c18-90b692796510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:13.243405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48a126-aeb2-4161-8c18-90b692796510 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:13.256989 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 197/403] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 19 17:27:13 2022] PUT /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28/groups/40d2d769c46d43119cd24be7997da2a8/roles/d7e1e74a1b2f48319ddb2eadb4ffa9a1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:27:13.256989 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6965a3-06ee-4766-9651-eaa427e2ddee None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:13.264405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 207/404] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:13.265844 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dfc3e-6fa1-476f-823c-903ceb01b44a None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:13.266131 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dfc3e-6fa1-476f-823c-903ceb01b44a None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:13.266497 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dfc3e-6fa1-476f-823c-903ceb01b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:13.289746 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-0b6dfc3e-6fa1-476f-823c-903ceb01b44a None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:13.291205 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-0b6dfc3e-6fa1-476f-823c-903ceb01b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:13.371385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6965a3-06ee-4766-9651-eaa427e2ddee None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:13.380850 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 208/405] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:13.382392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dfc3e-6fa1-476f-823c-903ceb01b44a None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:13.427126 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cff72-fba9-4a90-bfdb-724bf7eab608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:13.427781 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cff72-fba9-4a90-bfdb-724bf7eab608 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:13.428055 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cff72-fba9-4a90-bfdb-724bf7eab608 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:13.428322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cff72-fba9-4a90-bfdb-724bf7eab608 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:13.433734 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cff72-fba9-4a90-bfdb-724bf7eab608 None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:13.435690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cff72-fba9-4a90-bfdb-724bf7eab608 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:13.440746 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 198/406] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:13 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:13.443385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cff72-fba9-4a90-bfdb-724bf7eab608 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:13.448294 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:13.503800 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:13.541532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dfc3e-6fa1-476f-823c-903ceb01b44a None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:13.567601 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cff72-fba9-4a90-bfdb-724bf7eab608 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:13.588025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375860f-e381-4ad7-bb1f-358ed5d15947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:13.588860 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375860f-e381-4ad7-bb1f-358ed5d15947 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:13.589296 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375860f-e381-4ad7-bb1f-358ed5d15947 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:13.589666 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375860f-e381-4ad7-bb1f-358ed5d15947 None admin] PATH_INFO: `/v3/groups/40d2d769c46d43119cd24be7997da2a8` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:13.591599 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375860f-e381-4ad7-bb1f-358ed5d15947 None admin] RBAC: Authorizing `identity:get_group(group_id=40d2d769c46d43119cd24be7997da2a8)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:13.593339 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375860f-e381-4ad7-bb1f-358ed5d15947 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:13.599717 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 209/407] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:13 2022] GET /identity/v3/groups/40d2d769c46d43119cd24be7997da2a8 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:13.602151 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375860f-e381-4ad7-bb1f-358ed5d15947 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:13.616571 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40c100-f5e8-4d4f-9e22-fa7534a0b1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:13.617598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40c100-f5e8-4d4f-9e22-fa7534a0b1c4 None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:13.618071 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40c100-f5e8-4d4f-9e22-fa7534a0b1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:13.619142 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40c100-f5e8-4d4f-9e22-fa7534a0b1c4 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be/groups/40d2d769c46d43119cd24be7997da2a8/roles/f81ebe87e8a74c24a390dbaafdacdbce` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:13.627737 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40c100-f5e8-4d4f-9e22-fa7534a0b1c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eaaf654aca040a7bc85be7d785887be, group_id=40d2d769c46d43119cd24be7997da2a8, role_id=f81ebe87e8a74c24a390dbaafdacdbce)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:13.629439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40c100-f5e8-4d4f-9e22-fa7534a0b1c4 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:13.711134 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375860f-e381-4ad7-bb1f-358ed5d15947 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:13.727652 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 199/408] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 19 17:27:13 2022] PUT /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be/groups/40d2d769c46d43119cd24be7997da2a8/roles/f81ebe87e8a74c24a390dbaafdacdbce => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 17:27:13.749023 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0655-c202-479c-851b-56e2860ae680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:13.749660 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0655-c202-479c-851b-56e2860ae680 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:13.749935 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0655-c202-479c-851b-56e2860ae680 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:13.750203 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0655-c202-479c-851b-56e2860ae680 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:13.751373 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe0655-c202-479c-851b-56e2860ae680 None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:13.752901 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe0655-c202-479c-851b-56e2860ae680 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:13.754979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 210/409] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:13 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:13.761333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40c100-f5e8-4d4f-9e22-fa7534a0b1c4 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:13.825484 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0655-c202-479c-851b-56e2860ae680 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:13.849101 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:13.854707 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:13.932822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40c100-f5e8-4d4f-9e22-fa7534a0b1c4 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:13.983324 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ac4b-fb2e-4810-8602-de96e4f1dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:13.984371 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ac4b-fb2e-4810-8602-de96e4f1dc26 None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:13.984892 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ac4b-fb2e-4810-8602-de96e4f1dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:13.985372 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ac4b-fb2e-4810-8602-de96e4f1dc26 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be/groups/40d2d769c46d43119cd24be7997da2a8/roles/d7e1e74a1b2f48319ddb2eadb4ffa9a1` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:13.987936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ac4b-fb2e-4810-8602-de96e4f1dc26 None admin] RBAC: Authorizing `identity:create_grant(project_id=1eaaf654aca040a7bc85be7d785887be, group_id=40d2d769c46d43119cd24be7997da2a8, role_id=d7e1e74a1b2f48319ddb2eadb4ffa9a1)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:13.992610 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ac4b-fb2e-4810-8602-de96e4f1dc26 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:14.008564 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0655-c202-479c-851b-56e2860ae680 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:14.050605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84178f9e-6586-4853-bd0a-9fbeccc5d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:14.051521 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84178f9e-6586-4853-bd0a-9fbeccc5d8aa None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:14.052022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84178f9e-6586-4853-bd0a-9fbeccc5d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:14.052508 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84178f9e-6586-4853-bd0a-9fbeccc5d8aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:14.063960 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84178f9e-6586-4853-bd0a-9fbeccc5d8aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-84178f9e-6586-4853-bd0a-9fbeccc5d8aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:14.069458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:14.070675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:14.071751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:14.071751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:14.071751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:14.071751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:14.071751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:14.071751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:14.071751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:14.071751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:14.071751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:14.071751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:14.071751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:27:14.071751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:14.074176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 211/410] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:14.080896 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84178f9e-6586-4853-bd0a-9fbeccc5d8aa None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:14.099467 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 200/411] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 19 17:27:13 2022] PUT /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be/groups/40d2d769c46d43119cd24be7997da2a8/roles/d7e1e74a1b2f48319ddb2eadb4ffa9a1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:27:14.166150 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:14.204208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84178f9e-6586-4853-bd0a-9fbeccc5d8aa None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:14.255590 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087484-549c-4100-a928-28e8f29cca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:14.256288 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087484-549c-4100-a928-28e8f29cca55 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:14.256571 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087484-549c-4100-a928-28e8f29cca55 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:14.256868 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087484-549c-4100-a928-28e8f29cca55 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:14.257554 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5087484-549c-4100-a928-28e8f29cca55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:14.257858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5087484-549c-4100-a928-28e8f29cca55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:14.259377 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5087484-549c-4100-a928-28e8f29cca55 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:14.269176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 212/412] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:14.275675 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ac4b-fb2e-4810-8602-de96e4f1dc26 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:14.438968 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ac4b-fb2e-4810-8602-de96e4f1dc26 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:14.464506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:14.476347 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3215fba-b36e-4353-8946-ca8f64910948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:14.477038 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3215fba-b36e-4353-8946-ca8f64910948 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:14.477492 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3215fba-b36e-4353-8946-ca8f64910948 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:14.477775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3215fba-b36e-4353-8946-ca8f64910948 None admin] PATH_INFO: `/v3/groups/7539d1867156477982468c2a43dcaa23` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:14.479532 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3215fba-b36e-4353-8946-ca8f64910948 None admin] RBAC: Authorizing `identity:get_group(group_id=7539d1867156477982468c2a43dcaa23)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:14.487825 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3215fba-b36e-4353-8946-ca8f64910948 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:14.487825 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 201/413] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:14 2022] GET /identity/v3/groups/7539d1867156477982468c2a43dcaa23 => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:14.488607 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087484-549c-4100-a928-28e8f29cca55 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:14.612274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087484-549c-4100-a928-28e8f29cca55 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:14.645437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:14.654782 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57728514-83fb-43d9-b7e4-2fbd56e74b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:14.655416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57728514-83fb-43d9-b7e4-2fbd56e74b42 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:14.655694 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57728514-83fb-43d9-b7e4-2fbd56e74b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:14.655966 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57728514-83fb-43d9-b7e4-2fbd56e74b42 None admin] PATH_INFO: `/v3/projects/72d7a88be3624749bd4e592197eaa598` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:14.657128 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57728514-83fb-43d9-b7e4-2fbd56e74b42 None admin] RBAC: Authorizing `identity:get_project(project_id=72d7a88be3624749bd4e592197eaa598)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:14.659356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57728514-83fb-43d9-b7e4-2fbd56e74b42 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:14.661451 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 213/414] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:14 2022] GET /identity/v3/projects/72d7a88be3624749bd4e592197eaa598 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:14.666958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3215fba-b36e-4353-8946-ca8f64910948 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:14.692196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e6816-83ee-41a6-9988-97eb06564803 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:14.692518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e6816-83ee-41a6-9988-97eb06564803 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:14.692819 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e6816-83ee-41a6-9988-97eb06564803 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:14.695530 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 214/415] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:14.700141 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7bc2e-e197-4ca3-aed2-d8386aba7006 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:14.700426 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7bc2e-e197-4ca3-aed2-d8386aba7006 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:14.700704 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7bc2e-e197-4ca3-aed2-d8386aba7006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:14.725384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-a5a7bc2e-e197-4ca3-aed2-d8386aba7006 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:14.726581 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-a5a7bc2e-e197-4ca3-aed2-d8386aba7006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:14.816235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3215fba-b36e-4353-8946-ca8f64910948 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:14.848837 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 215/416] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:27:14.882631 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6743-ea9b-46ae-9d02-6d510fd11a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:14.883223 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6743-ea9b-46ae-9d02-6d510fd11a5a None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:14.883502 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6743-ea9b-46ae-9d02-6d510fd11a5a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:14.883776 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6743-ea9b-46ae-9d02-6d510fd11a5a None admin] PATH_INFO: `/v3/projects/72d7a88be3624749bd4e592197eaa598/groups/7539d1867156477982468c2a43dcaa23/roles/17791940429e48ac98d4bd49aa53a88c` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:14.889959 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b6743-ea9b-46ae-9d02-6d510fd11a5a None admin] RBAC: Authorizing `identity:create_grant(project_id=72d7a88be3624749bd4e592197eaa598, group_id=7539d1867156477982468c2a43dcaa23, role_id=17791940429e48ac98d4bd49aa53a88c)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:14.891404 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b6743-ea9b-46ae-9d02-6d510fd11a5a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:14.986893 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 202/417] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 19 17:27:14 2022] PUT /identity/v3/projects/72d7a88be3624749bd4e592197eaa598/groups/7539d1867156477982468c2a43dcaa23/roles/17791940429e48ac98d4bd49aa53a88c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:27:15.197896 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7bc2e-e197-4ca3-aed2-d8386aba7006 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:15.316958 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7bc2e-e197-4ca3-aed2-d8386aba7006 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:15.349873 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:15.360092 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17724de-da49-4c93-b0be-393532dbf0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:15.360754 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17724de-da49-4c93-b0be-393532dbf0ee None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:15.361035 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17724de-da49-4c93-b0be-393532dbf0ee None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:15.361304 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17724de-da49-4c93-b0be-393532dbf0ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:15.373368 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17724de-da49-4c93-b0be-393532dbf0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-f17724de-da49-4c93-b0be-393532dbf0ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:15.378418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:15.379295 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:15.380075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 216/418] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:15.386210 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6743-ea9b-46ae-9d02-6d510fd11a5a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:15.447527 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:15.516384 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6743-ea9b-46ae-9d02-6d510fd11a5a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:15.565942 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead38a3-ba97-4426-a747-32d42447cbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:15.566554 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead38a3-ba97-4426-a747-32d42447cbcf None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:15.566829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead38a3-ba97-4426-a747-32d42447cbcf None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:15.567095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead38a3-ba97-4426-a747-32d42447cbcf None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:15.567752 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead38a3-ba97-4426-a747-32d42447cbcf None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:15.568047 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead38a3-ba97-4426-a747-32d42447cbcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:15.569491 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead38a3-ba97-4426-a747-32d42447cbcf None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:15.579046 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 203/419] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:27:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:15.584811 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17724de-da49-4c93-b0be-393532dbf0ee None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:15.733337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17724de-da49-4c93-b0be-393532dbf0ee None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:15.788677 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736916c-35a3-4724-8df2-9e5c22e41d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:15.789259 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736916c-35a3-4724-8df2-9e5c22e41d1d None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:15.789539 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736916c-35a3-4724-8df2-9e5c22e41d1d None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:15.789813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736916c-35a3-4724-8df2-9e5c22e41d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:15.868090 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:15.885746 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736916c-35a3-4724-8df2-9e5c22e41d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:15.887203 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736916c-35a3-4724-8df2-9e5c22e41d1d None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:15.954599 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e575d-7d4d-4a2a-a2dc-8ac87fb421b6 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:15.955072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e575d-7d4d-4a2a-a2dc-8ac87fb421b6 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:15.955548 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e575d-7d4d-4a2a-a2dc-8ac87fb421b6 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:15.964129 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 204/420] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:15.974134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf8532-1da6-43ba-bd84-f7fabe4dd32e None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:15.974413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf8532-1da6-43ba-bd84-f7fabe4dd32e None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:15.974684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf8532-1da6-43ba-bd84-f7fabe4dd32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:16.013978 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 217/421] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:16.018469 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-28bf8532-1da6-43ba-bd84-f7fabe4dd32e None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:16.019650 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-28bf8532-1da6-43ba-bd84-f7fabe4dd32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:16.027223 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736916c-35a3-4724-8df2-9e5c22e41d1d None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:16.140538 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 205/422] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:16.161178 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:16.179054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736916c-35a3-4724-8df2-9e5c22e41d1d None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:16.230154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad6ee5-df3a-4e2a-bf44-1170c312fb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:16.231114 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad6ee5-df3a-4e2a-bf44-1170c312fb14 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:16.231591 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad6ee5-df3a-4e2a-bf44-1170c312fb14 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:16.232076 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad6ee5-df3a-4e2a-bf44-1170c312fb14 None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:16.233420 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad6ee5-df3a-4e2a-bf44-1170c312fb14 None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:16.235077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad6ee5-df3a-4e2a-bf44-1170c312fb14 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:16.237025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 218/423] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:16 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:16.242641 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf8532-1da6-43ba-bd84-f7fabe4dd32e None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:16.297645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:16.359480 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf8532-1da6-43ba-bd84-f7fabe4dd32e None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:16.394462 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e42f-cf38-4135-acf5-4853f00ac997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:16.395072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e42f-cf38-4135-acf5-4853f00ac997 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:16.395305 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e42f-cf38-4135-acf5-4853f00ac997 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:16.395545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e42f-cf38-4135-acf5-4853f00ac997 None admin] PATH_INFO: `/v3/groups/40d2d769c46d43119cd24be7997da2a8` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:16.396792 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46e42f-cf38-4135-acf5-4853f00ac997 None admin] RBAC: Authorizing `identity:get_group(group_id=40d2d769c46d43119cd24be7997da2a8)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:16.404801 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46e42f-cf38-4135-acf5-4853f00ac997 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:16.404801 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 206/424] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:16 2022] GET /identity/v3/groups/40d2d769c46d43119cd24be7997da2a8 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:16.406143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad6ee5-df3a-4e2a-bf44-1170c312fb14 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:16.549967 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad6ee5-df3a-4e2a-bf44-1170c312fb14 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:16.557660 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e42f-cf38-4135-acf5-4853f00ac997 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:16.609829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a83d8-dc06-40e7-8b78-2d3affd3d21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:16.610437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a83d8-dc06-40e7-8b78-2d3affd3d21e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:16.610716 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a83d8-dc06-40e7-8b78-2d3affd3d21e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:16.610986 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a83d8-dc06-40e7-8b78-2d3affd3d21e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:16.611712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a83d8-dc06-40e7-8b78-2d3affd3d21e None admin] RBAC: Adding query filter params (group.id=40d2d769c46d43119cd24be7997da2a8, role.id=f81ebe87e8a74c24a390dbaafdacdbce, scope.project.id=1819a9eb8b794d41999ed4c6e858aa28) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:16.612017 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a83d8-dc06-40e7-8b78-2d3affd3d21e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:16.613475 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a83d8-dc06-40e7-8b78-2d3affd3d21e None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:16.624543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 219/425] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 19 17:27:16 2022] GET /identity/v3/role_assignments?group.id=40d2d769c46d43119cd24be7997da2a8&scope.project.id=1819a9eb8b794d41999ed4c6e858aa28&role.id=f81ebe87e8a74c24a390dbaafdacdbce => generated 611 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:16.656794 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f375f-579d-441b-87af-fc99f83adb5d None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:16.657526 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f375f-579d-441b-87af-fc99f83adb5d None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:16.658005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f375f-579d-441b-87af-fc99f83adb5d None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:16.659596 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 220/426] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:27:16.665695 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619c987-e424-4067-a7f7-4f4e617c9ab9 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:16.666784 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619c987-e424-4067-a7f7-4f4e617c9ab9 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:16.667575 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619c987-e424-4067-a7f7-4f4e617c9ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:16.703364 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-3619c987-e424-4067-a7f7-4f4e617c9ab9 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:16.707239 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-3619c987-e424-4067-a7f7-4f4e617c9ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:16.737964 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:16.743723 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e42f-cf38-4135-acf5-4853f00ac997 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:16.760235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:16.782800 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79c113-23a3-4e8a-8dd8-0c33b8b47745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:16.783851 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79c113-23a3-4e8a-8dd8-0c33b8b47745 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:16.784332 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79c113-23a3-4e8a-8dd8-0c33b8b47745 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:16.784839 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79c113-23a3-4e8a-8dd8-0c33b8b47745 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:16.796887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79c113-23a3-4e8a-8dd8-0c33b8b47745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-2c79c113-23a3-4e8a-8dd8-0c33b8b47745 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:16.802085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:16.802983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:16.803787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:16.803787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:16.803787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:16.803787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:16.803787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:16.803787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:16.803787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:16.803787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:16.803787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:16.803787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:16.803787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:27:16.803787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:16.806184 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 207/427] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:27:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:16.813190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79c113-23a3-4e8a-8dd8-0c33b8b47745 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:16.859970 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 221/428] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:16.937613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79c113-23a3-4e8a-8dd8-0c33b8b47745 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:16.978818 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415b470-373f-411b-be92-4a0fda068ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:16.979695 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415b470-373f-411b-be92-4a0fda068ba5 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:16.980123 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415b470-373f-411b-be92-4a0fda068ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:16.980564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415b470-373f-411b-be92-4a0fda068ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:16.981442 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415b470-373f-411b-be92-4a0fda068ba5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:16.981898 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415b470-373f-411b-be92-4a0fda068ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:16.983481 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415b470-373f-411b-be92-4a0fda068ba5 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:16.994079 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 208/429] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:17.000794 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619c987-e424-4067-a7f7-4f4e617c9ab9 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:17.122205 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619c987-e424-4067-a7f7-4f4e617c9ab9 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:17.141650 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556f78c-cfeb-4db1-b971-c6906c6e1544 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:17.142157 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556f78c-cfeb-4db1-b971-c6906c6e1544 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:17.142581 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556f78c-cfeb-4db1-b971-c6906c6e1544 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:17.144281 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 209/430] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:17.149801 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba80573-f08a-4a18-bbb7-356f33df7078 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:17.150087 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba80573-f08a-4a18-bbb7-356f33df7078 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:17.150475 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba80573-f08a-4a18-bbb7-356f33df7078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:17.169311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33636f-9e84-4f13-a988-6260636e8e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:17.170207 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33636f-9e84-4f13-a988-6260636e8e03 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:17.170688 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33636f-9e84-4f13-a988-6260636e8e03 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:17.171399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33636f-9e84-4f13-a988-6260636e8e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:17.174493 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-7ba80573-f08a-4a18-bbb7-356f33df7078 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:17.175888 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-7ba80573-f08a-4a18-bbb7-356f33df7078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:17.194727 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:17.217082 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:17.261180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33636f-9e84-4f13-a988-6260636e8e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:17.262687 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33636f-9e84-4f13-a988-6260636e8e03 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:17.265810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 210/431] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:17.266836 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba80573-f08a-4a18-bbb7-356f33df7078 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:17.393936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba80573-f08a-4a18-bbb7-356f33df7078 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:17.410715 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 222/432] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:17.416860 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33636f-9e84-4f13-a988-6260636e8e03 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:17.452874 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3afe4-ae6f-4a63-bd48-319697f174ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:17.454322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3afe4-ae6f-4a63-bd48-319697f174ed None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:17.454894 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3afe4-ae6f-4a63-bd48-319697f174ed None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:17.455391 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3afe4-ae6f-4a63-bd48-319697f174ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:17.467465 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3afe4-ae6f-4a63-bd48-319697f174ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-c9a3afe4-ae6f-4a63-bd48-319697f174ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:17.472523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:17.481955 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 211/433] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:17.482760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3afe4-ae6f-4a63-bd48-319697f174ed None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:17.491523 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:17.511473 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:17.546286 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33636f-9e84-4f13-a988-6260636e8e03 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:17.585321 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497473-30a5-48ae-ba6a-2a8fbed3e4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:17.586308 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497473-30a5-48ae-ba6a-2a8fbed3e4fe None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:17.586726 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497473-30a5-48ae-ba6a-2a8fbed3e4fe None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:17.587157 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497473-30a5-48ae-ba6a-2a8fbed3e4fe None admin] PATH_INFO: `/v3/projects/1819a9eb8b794d41999ed4c6e858aa28` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:17.588569 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03497473-30a5-48ae-ba6a-2a8fbed3e4fe None admin] RBAC: Authorizing `identity:get_project(project_id=1819a9eb8b794d41999ed4c6e858aa28)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:17.590534 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03497473-30a5-48ae-ba6a-2a8fbed3e4fe None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:17.594113 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 223/434] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:17 2022] GET /identity/v3/projects/1819a9eb8b794d41999ed4c6e858aa28 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:17.597895 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3afe4-ae6f-4a63-bd48-319697f174ed None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:17.599806 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497473-30a5-48ae-ba6a-2a8fbed3e4fe None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:17.658632 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb99d3-9770-4d78-b243-673847c791b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:17.659249 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb99d3-9770-4d78-b243-673847c791b1 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:17.659529 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb99d3-9770-4d78-b243-673847c791b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:17.659800 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb99d3-9770-4d78-b243-673847c791b1 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:17.660594 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb99d3-9770-4d78-b243-673847c791b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:17.660988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb99d3-9770-4d78-b243-673847c791b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:17.663166 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb99d3-9770-4d78-b243-673847c791b1 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:17.676483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 212/435] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:27:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:17.677576 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb99d3-9770-4d78-b243-673847c791b1 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:17.713589 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497473-30a5-48ae-ba6a-2a8fbed3e4fe None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:17.735445 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:17.750324 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4f4f1-a423-4643-9af1-acd71c49fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:17.750956 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4f4f1-a423-4643-9af1-acd71c49fee0 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:17.751216 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4f4f1-a423-4643-9af1-acd71c49fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:17.751487 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4f4f1-a423-4643-9af1-acd71c49fee0 None admin] PATH_INFO: `/v3/groups/40d2d769c46d43119cd24be7997da2a8` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:17.752678 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4f4f1-a423-4643-9af1-acd71c49fee0 None admin] RBAC: Authorizing `identity:get_group(group_id=40d2d769c46d43119cd24be7997da2a8)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:17.754146 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4f4f1-a423-4643-9af1-acd71c49fee0 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:17.760433 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 224/436] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:17 2022] GET /identity/v3/groups/40d2d769c46d43119cd24be7997da2a8 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:17.760433 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4f4f1-a423-4643-9af1-acd71c49fee0 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:17.776011 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:17.790179 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb99d3-9770-4d78-b243-673847c791b1 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:17.824338 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6492de-b3e8-47f1-ada6-fce6b4cc6e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:17.825069 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6492de-b3e8-47f1-ada6-fce6b4cc6e36 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:17.825351 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6492de-b3e8-47f1-ada6-fce6b4cc6e36 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:17.825621 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6492de-b3e8-47f1-ada6-fce6b4cc6e36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:17.835429 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6492de-b3e8-47f1-ada6-fce6b4cc6e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-1e6492de-b3e8-47f1-ada6-fce6b4cc6e36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:17.840542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:17.841658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 213/437] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:27:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:17.845629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6492de-b3e8-47f1-ada6-fce6b4cc6e36 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:17.866030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4f4f1-a423-4643-9af1-acd71c49fee0 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:17.898856 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b802ff-955e-4a0d-ae34-956669c5e0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:17.899538 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b802ff-955e-4a0d-ae34-956669c5e0a6 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:17.900332 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b802ff-955e-4a0d-ae34-956669c5e0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:17.900597 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b802ff-955e-4a0d-ae34-956669c5e0a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:17.945307 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6492de-b3e8-47f1-ada6-fce6b4cc6e36 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:17.954880 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:17.973079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b802ff-955e-4a0d-ae34-956669c5e0a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:17.975217 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b802ff-955e-4a0d-ae34-956669c5e0a6 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:17.985174 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec145e-429e-4002-bd62-94b250ffcb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:17.985778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec145e-429e-4002-bd62-94b250ffcb3d None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:17.986055 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec145e-429e-4002-bd62-94b250ffcb3d None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:17.986329 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec145e-429e-4002-bd62-94b250ffcb3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:17.987053 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec145e-429e-4002-bd62-94b250ffcb3d None admin] RBAC: Adding query filter params (group.id=40d2d769c46d43119cd24be7997da2a8, role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1, scope.project.id=1819a9eb8b794d41999ed4c6e858aa28) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:17.987356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec145e-429e-4002-bd62-94b250ffcb3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:17.988795 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec145e-429e-4002-bd62-94b250ffcb3d None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:17.994744 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 214/438] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 19 17:27:17 2022] GET /identity/v3/role_assignments?group.id=40d2d769c46d43119cd24be7997da2a8&scope.project.id=1819a9eb8b794d41999ed4c6e858aa28&role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:17.995897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c2b26-d988-4ea7-88d8-aa6a3c64bc4c None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:17.996177 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c2b26-d988-4ea7-88d8-aa6a3c64bc4c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:17.996446 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c2b26-d988-4ea7-88d8-aa6a3c64bc4c None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:17.997839 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 215/439] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:18.001992 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c2b26-d988-4ea7-88d8-aa6a3c64bc4c None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:18.016320 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:18.092020 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 225/440] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:18.094264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110fd4c-9ac1-4106-aad6-eaef96c555c6 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:18.095143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110fd4c-9ac1-4106-aad6-eaef96c555c6 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:18.095621 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110fd4c-9ac1-4106-aad6-eaef96c555c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:18.115419 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-6110fd4c-9ac1-4106-aad6-eaef96c555c6 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:18.116631 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-6110fd4c-9ac1-4106-aad6-eaef96c555c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:18.120128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c2b26-d988-4ea7-88d8-aa6a3c64bc4c None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:18.160003 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44021b-bfb1-490e-b7a8-0251157e2b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:18.160655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44021b-bfb1-490e-b7a8-0251157e2b7d None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:18.160966 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44021b-bfb1-490e-b7a8-0251157e2b7d None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:18.161240 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44021b-bfb1-490e-b7a8-0251157e2b7d None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:18.161907 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44021b-bfb1-490e-b7a8-0251157e2b7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:18.162234 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44021b-bfb1-490e-b7a8-0251157e2b7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:18.163698 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44021b-bfb1-490e-b7a8-0251157e2b7d None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:18.180830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 216/441] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:18.180830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44021b-bfb1-490e-b7a8-0251157e2b7d None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:18.203411 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 226/442] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:18.205456 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110fd4c-9ac1-4106-aad6-eaef96c555c6 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:18.227577 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:18.262775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:18.294364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44021b-bfb1-490e-b7a8-0251157e2b7d None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:18.333242 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110fd4c-9ac1-4106-aad6-eaef96c555c6 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:18.335115 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f306a37-e627-4931-8955-334fce26606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:18.335752 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306a37-e627-4931-8955-334fce26606a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:18.336031 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306a37-e627-4931-8955-334fce26606a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:18.336910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f306a37-e627-4931-8955-334fce26606a None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:18.338569 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f306a37-e627-4931-8955-334fce26606a None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:18.340788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f306a37-e627-4931-8955-334fce26606a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:18.343175 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 217/443] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:18 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:18.348657 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f306a37-e627-4931-8955-334fce26606a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:18.376790 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b57191-cea2-4799-b08b-27d2107799f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:18.377398 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b57191-cea2-4799-b08b-27d2107799f7 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:18.377673 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b57191-cea2-4799-b08b-27d2107799f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:18.377943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b57191-cea2-4799-b08b-27d2107799f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:18.466255 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b57191-cea2-4799-b08b-27d2107799f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:18.467834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b57191-cea2-4799-b08b-27d2107799f7 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:18.485670 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f306a37-e627-4931-8955-334fce26606a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:18.487348 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:18.527003 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a4de0-798a-4e93-a337-6ac67e4d09e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:18.527741 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a4de0-798a-4e93-a337-6ac67e4d09e6 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:18.528018 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a4de0-798a-4e93-a337-6ac67e4d09e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:18.528292 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a4de0-798a-4e93-a337-6ac67e4d09e6 None admin] PATH_INFO: `/v3/groups/40d2d769c46d43119cd24be7997da2a8` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:18.529573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a4de0-798a-4e93-a337-6ac67e4d09e6 None admin] RBAC: Authorizing `identity:get_group(group_id=40d2d769c46d43119cd24be7997da2a8)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:18.531018 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a4de0-798a-4e93-a337-6ac67e4d09e6 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:18.532890 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 218/444] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:18 2022] GET /identity/v3/groups/40d2d769c46d43119cd24be7997da2a8 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:18.538643 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a4de0-798a-4e93-a337-6ac67e4d09e6 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:18.551681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:18.580101 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 227/445] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:18.580980 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b57191-cea2-4799-b08b-27d2107799f7 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:18.639409 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a4de0-798a-4e93-a337-6ac67e4d09e6 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:18.671760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acbcb4-13a7-4a53-aae2-bff9697cd0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:18.672350 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acbcb4-13a7-4a53-aae2-bff9697cd0a3 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:18.672624 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acbcb4-13a7-4a53-aae2-bff9697cd0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:18.672928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5acbcb4-13a7-4a53-aae2-bff9697cd0a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:18.673641 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acbcb4-13a7-4a53-aae2-bff9697cd0a3 None admin] RBAC: Adding query filter params (group.id=40d2d769c46d43119cd24be7997da2a8, role.id=f81ebe87e8a74c24a390dbaafdacdbce, scope.project.id=1eaaf654aca040a7bc85be7d785887be) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:18.673950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acbcb4-13a7-4a53-aae2-bff9697cd0a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:18.675369 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5acbcb4-13a7-4a53-aae2-bff9697cd0a3 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:18.679559 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b57191-cea2-4799-b08b-27d2107799f7 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:18.680854 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 219/446] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 19 17:27:18 2022] GET /identity/v3/role_assignments?group.id=40d2d769c46d43119cd24be7997da2a8&scope.project.id=1eaaf654aca040a7bc85be7d785887be&role.id=f81ebe87e8a74c24a390dbaafdacdbce => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:18.682140 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acbcb4-13a7-4a53-aae2-bff9697cd0a3 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:18.698826 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:18.720311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156572ff-9f0f-4984-a46b-fa96f49e4bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:18.721357 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156572ff-9f0f-4984-a46b-fa96f49e4bc8 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:18.721634 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156572ff-9f0f-4984-a46b-fa96f49e4bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:18.721905 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156572ff-9f0f-4984-a46b-fa96f49e4bc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:18.733804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156572ff-9f0f-4984-a46b-fa96f49e4bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-156572ff-9f0f-4984-a46b-fa96f49e4bc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:18.738854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:18.739821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:18.740622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 228/447] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:18.746957 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156572ff-9f0f-4984-a46b-fa96f49e4bc8 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:18.765195 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:18.798434 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5acbcb4-13a7-4a53-aae2-bff9697cd0a3 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:18.838137 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051056fc-e89e-4644-92b6-17c7f1079ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:18.838785 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051056fc-e89e-4644-92b6-17c7f1079ff6 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:18.839063 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051056fc-e89e-4644-92b6-17c7f1079ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:18.839334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051056fc-e89e-4644-92b6-17c7f1079ff6 None admin] PATH_INFO: `/v3/projects/1eaaf654aca040a7bc85be7d785887be` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:18.840603 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051056fc-e89e-4644-92b6-17c7f1079ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=1eaaf654aca040a7bc85be7d785887be)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:18.844383 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051056fc-e89e-4644-92b6-17c7f1079ff6 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:18.846169 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 220/448] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:18 2022] GET /identity/v3/projects/1eaaf654aca040a7bc85be7d785887be => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:18.852079 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051056fc-e89e-4644-92b6-17c7f1079ff6 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:18.875423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156572ff-9f0f-4984-a46b-fa96f49e4bc8 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:18.921532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb362d-cfc3-4d56-bb46-3ebdfab6b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:18.922865 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb362d-cfc3-4d56-bb46-3ebdfab6b642 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:18.923607 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb362d-cfc3-4d56-bb46-3ebdfab6b642 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:18.924070 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb362d-cfc3-4d56-bb46-3ebdfab6b642 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:18.925033 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb362d-cfc3-4d56-bb46-3ebdfab6b642 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:18.925675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb362d-cfc3-4d56-bb46-3ebdfab6b642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:18.927485 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb362d-cfc3-4d56-bb46-3ebdfab6b642 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:18.939175 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 229/449] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:18.945859 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb362d-cfc3-4d56-bb46-3ebdfab6b642 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:18.976990 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051056fc-e89e-4644-92b6-17c7f1079ff6 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:18.998041 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:19.023799 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f9214-8ec5-42df-8a98-e2e6a5d5effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:19.024430 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f9214-8ec5-42df-8a98-e2e6a5d5effc None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:19.024833 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f9214-8ec5-42df-8a98-e2e6a5d5effc None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:19.025072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f9214-8ec5-42df-8a98-e2e6a5d5effc None admin] PATH_INFO: `/v3/groups/40d2d769c46d43119cd24be7997da2a8` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:19.028848 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f9214-8ec5-42df-8a98-e2e6a5d5effc None admin] RBAC: Authorizing `identity:get_group(group_id=40d2d769c46d43119cd24be7997da2a8)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:19.030364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f9214-8ec5-42df-8a98-e2e6a5d5effc None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:19.032198 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 221/450] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:18 2022] GET /identity/v3/groups/40d2d769c46d43119cd24be7997da2a8 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:19.037753 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f9214-8ec5-42df-8a98-e2e6a5d5effc None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:19.049971 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:19.080021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb362d-cfc3-4d56-bb46-3ebdfab6b642 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:19.115373 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fe1ca-4138-4a2c-b8ff-2a2a0827b120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:19.115970 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fe1ca-4138-4a2c-b8ff-2a2a0827b120 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:19.116247 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fe1ca-4138-4a2c-b8ff-2a2a0827b120 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:19.116519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fe1ca-4138-4a2c-b8ff-2a2a0827b120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:19.141821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f9214-8ec5-42df-8a98-e2e6a5d5effc None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:19.175049 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07e1e9-84d7-4905-9ff0-c49b0bc572fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:19.175640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07e1e9-84d7-4905-9ff0-c49b0bc572fc None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:19.175920 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07e1e9-84d7-4905-9ff0-c49b0bc572fc None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:19.176191 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07e1e9-84d7-4905-9ff0-c49b0bc572fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:19.176937 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07e1e9-84d7-4905-9ff0-c49b0bc572fc None admin] RBAC: Adding query filter params (group.id=40d2d769c46d43119cd24be7997da2a8, role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1, scope.project.id=1eaaf654aca040a7bc85be7d785887be) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:19.177241 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07e1e9-84d7-4905-9ff0-c49b0bc572fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:19.178693 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07e1e9-84d7-4905-9ff0-c49b0bc572fc None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:19.184423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fe1ca-4138-4a2c-b8ff-2a2a0827b120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:19.184790 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 222/451] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 19 17:27:19 2022] GET /identity/v3/role_assignments?group.id=40d2d769c46d43119cd24be7997da2a8&scope.project.id=1eaaf654aca040a7bc85be7d785887be&role.id=d7e1e74a1b2f48319ddb2eadb4ffa9a1 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:19.185902 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fe1ca-4138-4a2c-b8ff-2a2a0827b120 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:19.226595 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:19.291695 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 230/452] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:19.297604 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07e1e9-84d7-4905-9ff0-c49b0bc572fc None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:19.370967 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:19.400498 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07e1e9-84d7-4905-9ff0-c49b0bc572fc None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:19.440361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f27f8-7bfa-4c85-adeb-d275cd0b424c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:19.441042 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f27f8-7bfa-4c85-adeb-d275cd0b424c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:19.441335 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f27f8-7bfa-4c85-adeb-d275cd0b424c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:19.441608 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f27f8-7bfa-4c85-adeb-d275cd0b424c None admin] PATH_INFO: `/v3/projects/72d7a88be3624749bd4e592197eaa598` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:19.442727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f27f8-7bfa-4c85-adeb-d275cd0b424c None admin] RBAC: Authorizing `identity:get_project(project_id=72d7a88be3624749bd4e592197eaa598)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:19.444173 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f27f8-7bfa-4c85-adeb-d275cd0b424c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:19.446789 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 223/453] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 19 17:27:19 2022] GET /identity/v3/projects/72d7a88be3624749bd4e592197eaa598 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:19.451349 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fe1ca-4138-4a2c-b8ff-2a2a0827b120 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:19.555140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fe1ca-4138-4a2c-b8ff-2a2a0827b120 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:19.589007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f47ed-4a37-4a8f-86a5-f887d8b8b459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:19.589618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f47ed-4a37-4a8f-86a5-f887d8b8b459 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:19.589891 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f47ed-4a37-4a8f-86a5-f887d8b8b459 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:19.590158 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f47ed-4a37-4a8f-86a5-f887d8b8b459 None admin] PATH_INFO: `/v3/groups/7539d1867156477982468c2a43dcaa23` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:19.591235 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f47ed-4a37-4a8f-86a5-f887d8b8b459 None admin] RBAC: Authorizing `identity:get_group(group_id=7539d1867156477982468c2a43dcaa23)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:19.592652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f47ed-4a37-4a8f-86a5-f887d8b8b459 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:19.594226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 231/454] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 19 17:27:19 2022] GET /identity/v3/groups/7539d1867156477982468c2a43dcaa23 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:19.600043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f27f8-7bfa-4c85-adeb-d275cd0b424c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:19.697268 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f27f8-7bfa-4c85-adeb-d275cd0b424c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:19.729414 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef892bd-8d4f-45b2-a848-b31cb266f227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:19.730000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef892bd-8d4f-45b2-a848-b31cb266f227 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:19.730278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef892bd-8d4f-45b2-a848-b31cb266f227 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:19.730548 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef892bd-8d4f-45b2-a848-b31cb266f227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:19.731261 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef892bd-8d4f-45b2-a848-b31cb266f227 None admin] RBAC: Adding query filter params (group.id=7539d1867156477982468c2a43dcaa23, role.id=17791940429e48ac98d4bd49aa53a88c, scope.project.id=72d7a88be3624749bd4e592197eaa598) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:19.731568 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef892bd-8d4f-45b2-a848-b31cb266f227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:19.733101 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef892bd-8d4f-45b2-a848-b31cb266f227 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:19.738589 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 224/455] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 19 17:27:19 2022] GET /identity/v3/role_assignments?group.id=7539d1867156477982468c2a43dcaa23&scope.project.id=72d7a88be3624749bd4e592197eaa598&role.id=17791940429e48ac98d4bd49aa53a88c => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:22.229867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18879e15-63f5-4e27-b02b-f8be2c95098c None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:22.230928 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18879e15-63f5-4e27-b02b-f8be2c95098c None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:22.231491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18879e15-63f5-4e27-b02b-f8be2c95098c None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:22.233510 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 232/456] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:22.239571 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de756fd-321d-4c58-9fc3-ef008cbda747 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:22.240554 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de756fd-321d-4c58-9fc3-ef008cbda747 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:22.241061 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de756fd-321d-4c58-9fc3-ef008cbda747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:22.249439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:22.262031 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-5de756fd-321d-4c58-9fc3-ef008cbda747 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:22.263484 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-5de756fd-321d-4c58-9fc3-ef008cbda747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:22.332809 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 225/457] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:22.390549 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538219ee-624c-40c0-84ac-1dd2616b977c None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:22.391186 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538219ee-624c-40c0-84ac-1dd2616b977c None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:22.391642 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538219ee-624c-40c0-84ac-1dd2616b977c None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:22.393428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 233/458] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:22.402070 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fadaee-0b64-4c4b-89b4-ffe46164421f None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:22.402611 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fadaee-0b64-4c4b-89b4-ffe46164421f None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:22.403122 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fadaee-0b64-4c4b-89b4-ffe46164421f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:22.421882 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-a8fadaee-0b64-4c4b-89b4-ffe46164421f None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:22.423416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-a8fadaee-0b64-4c4b-89b4-ffe46164421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:22.492616 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 226/459] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:22.522595 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceaabe-34b3-473c-a4b9-57504b7339f4 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:22.522876 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceaabe-34b3-473c-a4b9-57504b7339f4 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:22.523149 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceaabe-34b3-473c-a4b9-57504b7339f4 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:22.524748 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 234/460] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:22.530456 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6336dbe-8064-41a4-bd11-b8f1fa44e4e0 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:22.530849 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6336dbe-8064-41a4-bd11-b8f1fa44e4e0 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:22.531225 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6336dbe-8064-41a4-bd11-b8f1fa44e4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:22.551263 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-a6336dbe-8064-41a4-bd11-b8f1fa44e4e0 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:22.552894 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-a6336dbe-8064-41a4-bd11-b8f1fa44e4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:22.614568 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:22.623469 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 227/461] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:22.702185 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceaabe-34b3-473c-a4b9-57504b7339f4 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:22.712042 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:22.817020 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceaabe-34b3-473c-a4b9-57504b7339f4 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:22.829607 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6336dbe-8064-41a4-bd11-b8f1fa44e4e0 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:22.860005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680f424-9f85-49b2-b843-82928dbeae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:22.861193 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680f424-9f85-49b2-b843-82928dbeae02 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:22.861524 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680f424-9f85-49b2-b843-82928dbeae02 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:22.861807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680f424-9f85-49b2-b843-82928dbeae02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:22.877988 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680f424-9f85-49b2-b843-82928dbeae02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:22.880256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680f424-9f85-49b2-b843-82928dbeae02 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-d680f424-9f85-49b2-b843-82928dbeae02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:22.902022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:22.902998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:22.903860 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:22.903860 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:22.903860 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:22.904352 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 235/462] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:22.909793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680f424-9f85-49b2-b843-82928dbeae02 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:22.954186 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6336dbe-8064-41a4-bd11-b8f1fa44e4e0 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:22.981465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:22.989680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17614a9-5ee8-4d58-bf37-b1579123d801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:22.990296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17614a9-5ee8-4d58-bf37-b1579123d801 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:22.990569 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17614a9-5ee8-4d58-bf37-b1579123d801 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:22.990840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17614a9-5ee8-4d58-bf37-b1579123d801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:23.001024 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17614a9-5ee8-4d58-bf37-b1579123d801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:23.002467 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17614a9-5ee8-4d58-bf37-b1579123d801 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-a17614a9-5ee8-4d58-bf37-b1579123d801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:23.016376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:23.017518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:23.018385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:23.018385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:23.018385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:23.018385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 228/463] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:23.018945 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2bc7-69aa-4a5b-af94-4803376aa118 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:23.019221 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2bc7-69aa-4a5b-af94-4803376aa118 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:23.019495 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2bc7-69aa-4a5b-af94-4803376aa118 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:23.020854 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 229/464] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:23.021505 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c2bc7-69aa-4a5b-af94-4803376aa118 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:23.026165 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680f424-9f85-49b2-b843-82928dbeae02 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:23.060686 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c0135-f93b-403d-8f74-ec792b23eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:23.061318 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c0135-f93b-403d-8f74-ec792b23eefc None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:23.061598 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c0135-f93b-403d-8f74-ec792b23eefc None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:23.061869 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c0135-f93b-403d-8f74-ec792b23eefc None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:23.062501 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c0135-f93b-403d-8f74-ec792b23eefc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:23.062803 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c0135-f93b-403d-8f74-ec792b23eefc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:23.064158 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c0135-f93b-403d-8f74-ec792b23eefc None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:23.068093 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:23.075781 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 236/465] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:23.076560 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c0135-f93b-403d-8f74-ec792b23eefc None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:23.120958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c2bc7-69aa-4a5b-af94-4803376aa118 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:23.153533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692f740-159f-4f43-b3bc-1823373b4f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:23.154150 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692f740-159f-4f43-b3bc-1823373b4f09 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:23.154430 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692f740-159f-4f43-b3bc-1823373b4f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:23.154701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692f740-159f-4f43-b3bc-1823373b4f09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:23.164996 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692f740-159f-4f43-b3bc-1823373b4f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:23.167069 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692f740-159f-4f43-b3bc-1823373b4f09 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:23.178222 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c0135-f93b-403d-8f74-ec792b23eefc None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-4692f740-159f-4f43-b3bc-1823373b4f09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:23.180930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:23.181911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:23.183962 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:23.183962 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:23.183962 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:23.183962 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 230/466] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:23.183962 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2388ea-dd5a-44df-9c28-7cd51806e601 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:23.183962 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2388ea-dd5a-44df-9c28-7cd51806e601 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:23.183962 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2388ea-dd5a-44df-9c28-7cd51806e601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:23.201984 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-aa2388ea-dd5a-44df-9c28-7cd51806e601 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:23.202337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:23.203165 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-aa2388ea-dd5a-44df-9c28-7cd51806e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:23.220369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d481d-8b47-4eaf-ad66-404625a59534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:23.221008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d481d-8b47-4eaf-ad66-404625a59534 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:23.221284 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d481d-8b47-4eaf-ad66-404625a59534 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:23.221551 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d481d-8b47-4eaf-ad66-404625a59534 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:23.222187 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d481d-8b47-4eaf-ad66-404625a59534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:23.222491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d481d-8b47-4eaf-ad66-404625a59534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:23.223881 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d481d-8b47-4eaf-ad66-404625a59534 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:23.240154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 237/467] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:23.240154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d481d-8b47-4eaf-ad66-404625a59534 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:23.273730 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 231/468] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:23.274475 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2388ea-dd5a-44df-9c28-7cd51806e601 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:23.305950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:23.346907 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d481d-8b47-4eaf-ad66-404625a59534 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:23.379711 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2388ea-dd5a-44df-9c28-7cd51806e601 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:23.381481 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a223b18-684a-4b3c-b779-83a7476d099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:23.382809 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a223b18-684a-4b3c-b779-83a7476d099a None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:23.383095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a223b18-684a-4b3c-b779-83a7476d099a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:23.383366 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a223b18-684a-4b3c-b779-83a7476d099a None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:23.383988 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a223b18-684a-4b3c-b779-83a7476d099a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:23.385968 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a223b18-684a-4b3c-b779-83a7476d099a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:23.414013 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee5edb-23ce-42ac-a3b9-e5fffd63ecf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:23.414614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee5edb-23ce-42ac-a3b9-e5fffd63ecf3 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:23.414894 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee5edb-23ce-42ac-a3b9-e5fffd63ecf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:23.415170 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee5edb-23ce-42ac-a3b9-e5fffd63ecf3 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:23.415840 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee5edb-23ce-42ac-a3b9-e5fffd63ecf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:23.416140 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee5edb-23ce-42ac-a3b9-e5fffd63ecf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:23.417533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee5edb-23ce-42ac-a3b9-e5fffd63ecf3 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:23.429643 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 232/469] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:23.430810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee5edb-23ce-42ac-a3b9-e5fffd63ecf3 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:23.496322 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 238/470] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 19 17:27:23 2022] POST /identity/v3/users => generated 246 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:27:23.497202 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a223b18-684a-4b3c-b779-83a7476d099a None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:23.531277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:23.548914 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:23.549684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee5edb-23ce-42ac-a3b9-e5fffd63ecf3 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:23.595104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f67d5-893a-45ae-ac0b-e57fc361995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:23.595775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f67d5-893a-45ae-ac0b-e57fc361995d None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:23.596057 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f67d5-893a-45ae-ac0b-e57fc361995d None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:23.596330 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f67d5-893a-45ae-ac0b-e57fc361995d None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:23.597073 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f67d5-893a-45ae-ac0b-e57fc361995d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:23.598594 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f67d5-893a-45ae-ac0b-e57fc361995d None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:23.640299 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a223b18-684a-4b3c-b779-83a7476d099a None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:23.677265 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03671e-4c16-41cd-ab31-167a02f41d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:23.677878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03671e-4c16-41cd-ab31-167a02f41d62 None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:23.678175 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03671e-4c16-41cd-ab31-167a02f41d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:23.678432 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03671e-4c16-41cd-ab31-167a02f41d62 None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:23.679070 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03671e-4c16-41cd-ab31-167a02f41d62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:23.680512 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03671e-4c16-41cd-ab31-167a02f41d62 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:23.695861 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 233/471] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 19 17:27:23 2022] POST /identity/v3/users => generated 248 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:27:23.697439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f67d5-893a-45ae-ac0b-e57fc361995d None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:23.793388 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 239/472] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 19 17:27:23 2022] POST /identity/v3/users => generated 248 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:27:23.829004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f67d5-893a-45ae-ac0b-e57fc361995d None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:23.877352 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8f6d7-bdb2-4dbc-915a-c1df420ca571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:23.878483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8f6d7-bdb2-4dbc-915a-c1df420ca571 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:23.878983 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8f6d7-bdb2-4dbc-915a-c1df420ca571 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:23.879457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8f6d7-bdb2-4dbc-915a-c1df420ca571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:23.893772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8f6d7-bdb2-4dbc-915a-c1df420ca571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:23.895807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8f6d7-bdb2-4dbc-915a-c1df420ca571 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:23.899150 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-28d8f6d7-bdb2-4dbc-915a-c1df420ca571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:23.912585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:23.913591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:23.914460 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:23.914460 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:23.914460 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:23.914460 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 234/473] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:23.920082 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03671e-4c16-41cd-ab31-167a02f41d62 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:24.038508 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:24.049465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03671e-4c16-41cd-ab31-167a02f41d62 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:24.092338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85195d20-3978-4b3b-9e63-d975e7f2c5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:24.092993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85195d20-3978-4b3b-9e63-d975e7f2c5fe None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:24.093279 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85195d20-3978-4b3b-9e63-d975e7f2c5fe None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:24.093555 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85195d20-3978-4b3b-9e63-d975e7f2c5fe None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:24.094206 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85195d20-3978-4b3b-9e63-d975e7f2c5fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:24.094511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85195d20-3978-4b3b-9e63-d975e7f2c5fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:24.095893 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85195d20-3978-4b3b-9e63-d975e7f2c5fe None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:24.109393 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 240/474] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:24.114822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8f6d7-bdb2-4dbc-915a-c1df420ca571 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:24.223550 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8f6d7-bdb2-4dbc-915a-c1df420ca571 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:24.259758 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26535b-8bee-46e6-ac13-46f6884e7a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:24.260765 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26535b-8bee-46e6-ac13-46f6884e7a0a None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:24.261259 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26535b-8bee-46e6-ac13-46f6884e7a0a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:24.261720 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26535b-8bee-46e6-ac13-46f6884e7a0a None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:24.262547 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26535b-8bee-46e6-ac13-46f6884e7a0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:24.264155 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26535b-8bee-46e6-ac13-46f6884e7a0a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:24.345205 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 235/475] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 19 17:27:24 2022] POST /identity/v3/users => generated 249 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:27:25.861977 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa43dd8-fea0-431f-8c64-ffd7e061f1f7 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:25.862967 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa43dd8-fea0-431f-8c64-ffd7e061f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:25.863478 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa43dd8-fea0-431f-8c64-ffd7e061f1f7 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:25.865484 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 241/476] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:25.871781 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57073bab-1ac1-46d7-a201-078e7e26308a None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:25.872760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57073bab-1ac1-46d7-a201-078e7e26308a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:25.873244 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57073bab-1ac1-46d7-a201-078e7e26308a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:25.892443 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-57073bab-1ac1-46d7-a201-078e7e26308a None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:25.894073 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-57073bab-1ac1-46d7-a201-078e7e26308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:25.943926 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:25.966505 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 236/477] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:26.013941 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7015e-1e2d-4703-91be-a36f08f95b1f None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.014249 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7015e-1e2d-4703-91be-a36f08f95b1f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.014491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7015e-1e2d-4703-91be-a36f08f95b1f None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.016106 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 242/478] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:26.021376 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ac0a7-fd19-45ef-b7dd-889afbc96b91 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.021662 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ac0a7-fd19-45ef-b7dd-889afbc96b91 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.021936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ac0a7-fd19-45ef-b7dd-889afbc96b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.039841 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-fa2ac0a7-fd19-45ef-b7dd-889afbc96b91 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:26.041099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-fa2ac0a7-fd19-45ef-b7dd-889afbc96b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:26.120953 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 237/479] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:26.148516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce6ab2-c34e-4be7-ab7f-f2bf3ea08acc None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.148825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce6ab2-c34e-4be7-ab7f-f2bf3ea08acc None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.149104 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce6ab2-c34e-4be7-ab7f-f2bf3ea08acc None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.150456 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 243/480] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:26.155868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e8346-1a1b-4082-9275-f5954e282d73 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.156157 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e8346-1a1b-4082-9275-f5954e282d73 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.156430 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e8346-1a1b-4082-9275-f5954e282d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.174611 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-969e8346-1a1b-4082-9275-f5954e282d73 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:26.175786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-969e8346-1a1b-4082-9275-f5954e282d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:26.242763 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 238/481] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:26.341089 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce6ab2-c34e-4be7-ab7f-f2bf3ea08acc None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:26.446346 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e8346-1a1b-4082-9275-f5954e282d73 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:26.453092 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce6ab2-c34e-4be7-ab7f-f2bf3ea08acc None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:26.503214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284d1ba-d3d4-4a70-b601-31c77c7414e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:26.504449 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284d1ba-d3d4-4a70-b601-31c77c7414e2 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.505097 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284d1ba-d3d4-4a70-b601-31c77c7414e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.505597 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284d1ba-d3d4-4a70-b601-31c77c7414e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.509129 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:26.521980 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284d1ba-d3d4-4a70-b601-31c77c7414e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-9284d1ba-d3d4-4a70-b601-31c77c7414e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:26.526990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:26.532518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:26.533872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 244/482] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:26.535566 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284d1ba-d3d4-4a70-b601-31c77c7414e2 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:26.549428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:26.561471 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e8346-1a1b-4082-9275-f5954e282d73 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:26.599869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a118c-ee15-4453-9d44-44a118d70d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:26.600683 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a118c-ee15-4453-9d44-44a118d70d09 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.600982 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a118c-ee15-4453-9d44-44a118d70d09 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.601259 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a118c-ee15-4453-9d44-44a118d70d09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.613005 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a118c-ee15-4453-9d44-44a118d70d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-7b5a118c-ee15-4453-9d44-44a118d70d09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:26.617933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:26.619403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:26.620206 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 239/483] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:26.621474 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a118c-ee15-4453-9d44-44a118d70d09 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:26.646820 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284d1ba-d3d4-4a70-b601-31c77c7414e2 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:26.682401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e9501-e6cd-4b8b-936b-e45fc9479740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:26.682924 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e9501-e6cd-4b8b-936b-e45fc9479740 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.683198 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e9501-e6cd-4b8b-936b-e45fc9479740 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.683464 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e9501-e6cd-4b8b-936b-e45fc9479740 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.684114 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e9501-e6cd-4b8b-936b-e45fc9479740 None admin] RBAC: Adding query filter params (name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:26.684410 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e9501-e6cd-4b8b-936b-e45fc9479740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:26.685829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e9501-e6cd-4b8b-936b-e45fc9479740 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:26.693506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 245/484] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:27:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:26.698165 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e9501-e6cd-4b8b-936b-e45fc9479740 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:26.718972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a118c-ee15-4453-9d44-44a118d70d09 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:26.720460 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:26.754322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69ace-64fa-4a96-8cb5-c6726e9a44c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:26.754943 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69ace-64fa-4a96-8cb5-c6726e9a44c1 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.755220 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69ace-64fa-4a96-8cb5-c6726e9a44c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.755489 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69ace-64fa-4a96-8cb5-c6726e9a44c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.765549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69ace-64fa-4a96-8cb5-c6726e9a44c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:26.767897 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-e3f69ace-64fa-4a96-8cb5-c6726e9a44c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:26.770104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:26.771178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:26.771974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 240/485] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:26.772644 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931797b1-5ece-4870-a2d5-4f4544891628 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.772921 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931797b1-5ece-4870-a2d5-4f4544891628 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.773191 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931797b1-5ece-4870-a2d5-4f4544891628 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.774394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 241/486] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:26.775611 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931797b1-5ece-4870-a2d5-4f4544891628 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:26.803887 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e9501-e6cd-4b8b-936b-e45fc9479740 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:26.836384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa79286-61e5-459c-ba4c-d8b0d250b892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:26.837000 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa79286-61e5-459c-ba4c-d8b0d250b892 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.837286 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa79286-61e5-459c-ba4c-d8b0d250b892 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.838090 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa79286-61e5-459c-ba4c-d8b0d250b892 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.838736 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa79286-61e5-459c-ba4c-d8b0d250b892 None admin] RBAC: Adding query filter params (name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:26.839033 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa79286-61e5-459c-ba4c-d8b0d250b892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:26.840395 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa79286-61e5-459c-ba4c-d8b0d250b892 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:26.848184 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 246/487] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:27:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:26.848822 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa79286-61e5-459c-ba4c-d8b0d250b892 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:26.877848 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931797b1-5ece-4870-a2d5-4f4544891628 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:26.911105 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24473b9e-41a6-4a04-a563-9c32c5ff76c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:26.911722 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24473b9e-41a6-4a04-a563-9c32c5ff76c0 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.912001 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24473b9e-41a6-4a04-a563-9c32c5ff76c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.912270 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24473b9e-41a6-4a04-a563-9c32c5ff76c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.923500 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24473b9e-41a6-4a04-a563-9c32c5ff76c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:26.924987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24473b9e-41a6-4a04-a563-9c32c5ff76c0 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-24473b9e-41a6-4a04-a563-9c32c5ff76c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:26.938769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:26.939637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:26.940489 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:26.940489 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:26.940489 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:26.940489 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 242/488] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:26.940966 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631f42b-3a09-4b4e-8a73-6ab0f4685fe2 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.941179 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631f42b-3a09-4b4e-8a73-6ab0f4685fe2 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.941448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631f42b-3a09-4b4e-8a73-6ab0f4685fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.952675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa79286-61e5-459c-ba4c-d8b0d250b892 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:26.958278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-6631f42b-3a09-4b4e-8a73-6ab0f4685fe2 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:26.959455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-6631f42b-3a09-4b4e-8a73-6ab0f4685fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:26.969490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:26.986801 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d69c17-f9c3-4a8e-bc60-34329dc7775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:26.987399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d69c17-f9c3-4a8e-bc60-34329dc7775b None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:26.987682 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d69c17-f9c3-4a8e-bc60-34329dc7775b None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:26.987956 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d69c17-f9c3-4a8e-bc60-34329dc7775b None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:26.988608 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d69c17-f9c3-4a8e-bc60-34329dc7775b None admin] RBAC: Adding query filter params (name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:26.988944 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d69c17-f9c3-4a8e-bc60-34329dc7775b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:26.990306 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d69c17-f9c3-4a8e-bc60-34329dc7775b None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:26.991620 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:26.999159 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 247/489] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:27:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:26.999945 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d69c17-f9c3-4a8e-bc60-34329dc7775b None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:27.027006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 243/490] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:27.027837 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631f42b-3a09-4b4e-8a73-6ab0f4685fe2 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:27.104031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d69c17-f9c3-4a8e-bc60-34329dc7775b None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:27.133381 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631f42b-3a09-4b4e-8a73-6ab0f4685fe2 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:27.141198 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f61725-3586-4493-b99d-299fce440b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:27.141814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f61725-3586-4493-b99d-299fce440b3e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:27.142089 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f61725-3586-4493-b99d-299fce440b3e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:27.142363 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f61725-3586-4493-b99d-299fce440b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:27.153908 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f61725-3586-4493-b99d-299fce440b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:27.155474 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f61725-3586-4493-b99d-299fce440b3e None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:27.170253 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8ad51-91e6-476a-913c-4288a048e31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:27.170847 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8ad51-91e6-476a-913c-4288a048e31e None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:27.171392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8ad51-91e6-476a-913c-4288a048e31e None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-f4f61725-3586-4493-b99d-299fce440b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:27.171492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:27.172385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:27.173270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:27.173270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:27.173270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:27.173439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8ad51-91e6-476a-913c-4288a048e31e None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:27.173439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8ad51-91e6-476a-913c-4288a048e31e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:27.173439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8ad51-91e6-476a-913c-4288a048e31e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:27.174023 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8ad51-91e6-476a-913c-4288a048e31e None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:27.177166 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 248/491] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:27.177787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f61725-3586-4493-b99d-299fce440b3e None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:27.190429 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 244/492] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:27.190429 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8ad51-91e6-476a-913c-4288a048e31e None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:27.194348 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:27.234127 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:27.291101 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8ad51-91e6-476a-913c-4288a048e31e None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:27.291434 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f61725-3586-4493-b99d-299fce440b3e None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:27.326293 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72b12f-758c-4193-a680-ad1014266bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:27.326886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72b12f-758c-4193-a680-ad1014266bee None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:27.327160 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72b12f-758c-4193-a680-ad1014266bee None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:27.327468 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72b12f-758c-4193-a680-ad1014266bee None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:27.328049 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72b12f-758c-4193-a680-ad1014266bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:27.328302 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf11781-a0d1-433c-9512-372b9b15b79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:27.328411 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72b12f-758c-4193-a680-ad1014266bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:27.328956 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf11781-a0d1-433c-9512-372b9b15b79c None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:27.329238 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf11781-a0d1-433c-9512-372b9b15b79c None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:27.329506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf11781-a0d1-433c-9512-372b9b15b79c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:27.329778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72b12f-758c-4193-a680-ad1014266bee None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:27.341635 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf11781-a0d1-433c-9512-372b9b15b79c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:27.346891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 245/493] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:27.346891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72b12f-758c-4193-a680-ad1014266bee None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:27.347124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf11781-a0d1-433c-9512-372b9b15b79c None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-9cf11781-a0d1-433c-9512-372b9b15b79c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:27.360199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:27.361412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:27.362557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:27.362557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:27.362557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:27.362557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 249/494] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:27.362557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf11781-a0d1-433c-9512-372b9b15b79c None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:27.413812 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:27.455407 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72b12f-758c-4193-a680-ad1014266bee None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:27.463294 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:27.466259 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf11781-a0d1-433c-9512-372b9b15b79c None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:27.489255 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70632b12-4942-4861-8e46-3de59fcc74ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:27.489869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70632b12-4942-4861-8e46-3de59fcc74ce None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:27.490150 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70632b12-4942-4861-8e46-3de59fcc74ce None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:27.490418 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70632b12-4942-4861-8e46-3de59fcc74ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:27.497855 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70632b12-4942-4861-8e46-3de59fcc74ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:27.499128 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9455a-106b-482c-8709-18af7e530f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:27.499295 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70632b12-4942-4861-8e46-3de59fcc74ce None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:27.499737 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9455a-106b-482c-8709-18af7e530f79 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:27.500015 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9455a-106b-482c-8709-18af7e530f79 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:27.500283 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9455a-106b-482c-8709-18af7e530f79 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:27.507500 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9455a-106b-482c-8709-18af7e530f79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:27.508953 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9455a-106b-482c-8709-18af7e530f79 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-70632b12-4942-4861-8e46-3de59fcc74ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:27.512156 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:27.513083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:27.513970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:27.513970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:27.513970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:27.513970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:27.513970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:27.513970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:27.513970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:27.513970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:27.513970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:27:27.513970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:27.516867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 246/495] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 19 17:27:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:27.517947 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70632b12-4942-4861-8e46-3de59fcc74ce None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-01e9455a-106b-482c-8709-18af7e530f79 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:27.521619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:27.522517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:27.523392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:27.523392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:27.523392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:27.523392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:27.523392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:27.523392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:27.523392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:27.523392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:27.523392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 17:27:27.523392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:27.523392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 250/496] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:27.523937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9455a-106b-482c-8709-18af7e530f79 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:27.621705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70632b12-4942-4861-8e46-3de59fcc74ce None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:27.625675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9455a-106b-482c-8709-18af7e530f79 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:27.643916 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:27.654190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dff09-50a5-4230-8120-ecb2c8e6edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:27.656195 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dff09-50a5-4230-8120-ecb2c8e6edaf None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:27.656195 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dff09-50a5-4230-8120-ecb2c8e6edaf None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:27.656195 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dff09-50a5-4230-8120-ecb2c8e6edaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:27.659258 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0baa9-fdaa-4b47-aa50-177810414a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:27.659798 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0baa9-fdaa-4b47-aa50-177810414a60 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:27.660077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0baa9-fdaa-4b47-aa50-177810414a60 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:27.660346 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0baa9-fdaa-4b47-aa50-177810414a60 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:27.661041 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0baa9-fdaa-4b47-aa50-177810414a60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:27.661302 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0baa9-fdaa-4b47-aa50-177810414a60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:27.662680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0baa9-fdaa-4b47-aa50-177810414a60 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:27.666223 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316dff09-50a5-4230-8120-ecb2c8e6edaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-316dff09-50a5-4230-8120-ecb2c8e6edaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:27.670938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:27.672134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:27.673531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 247/497] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:27.674282 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dff09-50a5-4230-8120-ecb2c8e6edaf None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:27.683137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 251/498] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:27.683137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0baa9-fdaa-4b47-aa50-177810414a60 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:27.701937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:27.773598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dff09-50a5-4230-8120-ecb2c8e6edaf None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:27.777511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0baa9-fdaa-4b47-aa50-177810414a60 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:27.806045 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bcfc3-062b-4bec-808a-fdc4f8271ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:27.807219 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bcfc3-062b-4bec-808a-fdc4f8271ea5 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:27.807500 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bcfc3-062b-4bec-808a-fdc4f8271ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:27.807770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bcfc3-062b-4bec-808a-fdc4f8271ea5 None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:27.808479 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bcfc3-062b-4bec-808a-fdc4f8271ea5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:27.808812 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bcfc3-062b-4bec-808a-fdc4f8271ea5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:27.810270 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bcfc3-062b-4bec-808a-fdc4f8271ea5 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:27.811755 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eb87a-0fc7-4381-8e20-f967ff654ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:27.812348 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eb87a-0fc7-4381-8e20-f967ff654ecb None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:27.812624 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eb87a-0fc7-4381-8e20-f967ff654ecb None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:27.812923 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eb87a-0fc7-4381-8e20-f967ff654ecb None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:27.813641 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076eb87a-0fc7-4381-8e20-f967ff654ecb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:27.813944 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076eb87a-0fc7-4381-8e20-f967ff654ecb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:27.815345 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076eb87a-0fc7-4381-8e20-f967ff654ecb None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:27.846295 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 248/499] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 19 17:27:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:27.847107 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bcfc3-062b-4bec-808a-fdc4f8271ea5 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:27.859426 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 252/500] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 19 17:27:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:27.859426 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eb87a-0fc7-4381-8e20-f967ff654ecb None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:27.890187 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:27.934041 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:27.946524 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bcfc3-062b-4bec-808a-fdc4f8271ea5 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:27.954341 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eb87a-0fc7-4381-8e20-f967ff654ecb None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:27.988597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce191d8-0a18-409c-bfa5-ccf0824a4a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:27.989275 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce191d8-0a18-409c-bfa5-ccf0824a4a18 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:27.989561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce191d8-0a18-409c-bfa5-ccf0824a4a18 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:27.989828 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce191d8-0a18-409c-bfa5-ccf0824a4a18 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:27.990484 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce191d8-0a18-409c-bfa5-ccf0824a4a18 None admin] RBAC: Adding query filter params (name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:27.990784 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce191d8-0a18-409c-bfa5-ccf0824a4a18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:27.992169 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce191d8-0a18-409c-bfa5-ccf0824a4a18 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:27.994645 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632ccf-c349-41ab-98e0-0daa1dc884b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:27.995581 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632ccf-c349-41ab-98e0-0daa1dc884b0 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:27.995856 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632ccf-c349-41ab-98e0-0daa1dc884b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:27.996125 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632ccf-c349-41ab-98e0-0daa1dc884b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:28.000676 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 249/501] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:27:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:28.001482 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce191d8-0a18-409c-bfa5-ccf0824a4a18 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:28.003300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632ccf-c349-41ab-98e0-0daa1dc884b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:28.005872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632ccf-c349-41ab-98e0-0daa1dc884b0 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-40632ccf-c349-41ab-98e0-0daa1dc884b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:28.017266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:28.018179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:28.019091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:28.019091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:28.019091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:28.019091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:28.019091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:28.019091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:28.019091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:28.019091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:28.019091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:27:28.019091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:28.019091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 253/502] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:28.019091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632ccf-c349-41ab-98e0-0daa1dc884b0 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:28.106760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce191d8-0a18-409c-bfa5-ccf0824a4a18 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:28.109386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:28.127301 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632ccf-c349-41ab-98e0-0daa1dc884b0 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:28.140678 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de1cc8-503e-412b-ad65-965552f3b84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:28.141475 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de1cc8-503e-412b-ad65-965552f3b84e None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:28.141913 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de1cc8-503e-412b-ad65-965552f3b84e None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:28.142531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de1cc8-503e-412b-ad65-965552f3b84e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:28.160557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d78a0-1915-40f8-82af-e44cd4398a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:28.161171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d78a0-1915-40f8-82af-e44cd4398a4a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:28.161446 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d78a0-1915-40f8-82af-e44cd4398a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:28.161711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d78a0-1915-40f8-82af-e44cd4398a4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:28.170452 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:28.208890 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de1cc8-503e-412b-ad65-965552f3b84e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:28.210349 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de1cc8-503e-412b-ad65-965552f3b84e None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:28.228797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d78a0-1915-40f8-82af-e44cd4398a4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:28.230240 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d78a0-1915-40f8-82af-e44cd4398a4a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:28.307940 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 250/503] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:28.308793 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de1cc8-503e-412b-ad65-965552f3b84e None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:28.313355 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:28.344862 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 254/504] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:28.345790 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d78a0-1915-40f8-82af-e44cd4398a4a None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:28.386337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:28.410085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de1cc8-503e-412b-ad65-965552f3b84e None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:28.445100 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b224da-f4c6-4ed2-ab0c-67360088a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:28.445723 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b224da-f4c6-4ed2-ab0c-67360088a292 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:28.446002 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b224da-f4c6-4ed2-ab0c-67360088a292 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:28.446273 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b224da-f4c6-4ed2-ab0c-67360088a292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:28.447007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d78a0-1915-40f8-82af-e44cd4398a4a None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:28.456047 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b224da-f4c6-4ed2-ab0c-67360088a292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:28.457521 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b224da-f4c6-4ed2-ab0c-67360088a292 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-01b224da-f4c6-4ed2-ab0c-67360088a292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:28.472449 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:28.473457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:28.474302 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:28.474302 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:28.474302 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:28.474302 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 251/505] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:28.474302 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b224da-f4c6-4ed2-ab0c-67360088a292 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:28.486996 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9541b-0aca-4c7a-9460-9da8ec2f6292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:28.487597 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9541b-0aca-4c7a-9460-9da8ec2f6292 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:28.487876 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9541b-0aca-4c7a-9460-9da8ec2f6292 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:28.488147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9541b-0aca-4c7a-9460-9da8ec2f6292 None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:28.488907 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9541b-0aca-4c7a-9460-9da8ec2f6292 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:28.489211 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9541b-0aca-4c7a-9460-9da8ec2f6292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:28.490636 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9541b-0aca-4c7a-9460-9da8ec2f6292 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:28.508934 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 255/506] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 19 17:27:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:28.509739 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9541b-0aca-4c7a-9460-9da8ec2f6292 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:28.532232 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:28.576199 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b224da-f4c6-4ed2-ab0c-67360088a292 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:28.604284 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:28.608919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216ada6-dd21-48c7-81c2-f3d55098fcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:28.609537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216ada6-dd21-48c7-81c2-f3d55098fcdd None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:28.609814 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216ada6-dd21-48c7-81c2-f3d55098fcdd None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:28.610025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9541b-0aca-4c7a-9460-9da8ec2f6292 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:28.610133 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216ada6-dd21-48c7-81c2-f3d55098fcdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:28.620539 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216ada6-dd21-48c7-81c2-f3d55098fcdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:28.622020 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216ada6-dd21-48c7-81c2-f3d55098fcdd None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-e216ada6-dd21-48c7-81c2-f3d55098fcdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:28.636085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:28.637254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:28.638325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:28.638325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:28.638325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:28.638325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 252/507] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:28.638325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216ada6-dd21-48c7-81c2-f3d55098fcdd None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:28.648027 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637089af-1c5b-4051-bd1e-1d46aca32d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:28.648644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637089af-1c5b-4051-bd1e-1d46aca32d9a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:28.648994 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637089af-1c5b-4051-bd1e-1d46aca32d9a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:28.649268 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637089af-1c5b-4051-bd1e-1d46aca32d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:28.659779 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637089af-1c5b-4051-bd1e-1d46aca32d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:28.661286 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637089af-1c5b-4051-bd1e-1d46aca32d9a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-637089af-1c5b-4051-bd1e-1d46aca32d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:28.675951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:28.676911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:28.678144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:28.678144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:28.678144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:28.678144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 256/508] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:28.678373 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637089af-1c5b-4051-bd1e-1d46aca32d9a None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:28.737775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216ada6-dd21-48c7-81c2-f3d55098fcdd None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:28.746495 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:28.771480 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267cf94-eced-4059-8943-ab511b062fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:28.772074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267cf94-eced-4059-8943-ab511b062fcc None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:28.772355 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267cf94-eced-4059-8943-ab511b062fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:28.772626 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267cf94-eced-4059-8943-ab511b062fcc None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:28.773288 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267cf94-eced-4059-8943-ab511b062fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:28.773589 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267cf94-eced-4059-8943-ab511b062fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:28.775529 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267cf94-eced-4059-8943-ab511b062fcc None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:28.780052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637089af-1c5b-4051-bd1e-1d46aca32d9a None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:28.788495 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 253/509] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:28.789305 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267cf94-eced-4059-8943-ab511b062fcc None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:28.812842 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b133ad-3b0e-4a3e-85a0-003949109d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:28.813431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b133ad-3b0e-4a3e-85a0-003949109d8c None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:28.813710 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b133ad-3b0e-4a3e-85a0-003949109d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:28.813977 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b133ad-3b0e-4a3e-85a0-003949109d8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:28.832773 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:28.882037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b133ad-3b0e-4a3e-85a0-003949109d8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:28.883506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b133ad-3b0e-4a3e-85a0-003949109d8c None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:28.887417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267cf94-eced-4059-8943-ab511b062fcc None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:28.921624 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fec08-5592-4b1b-a224-8d0511b8cbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:28.922211 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fec08-5592-4b1b-a224-8d0511b8cbb9 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:28.922489 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fec08-5592-4b1b-a224-8d0511b8cbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:28.922761 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fec08-5592-4b1b-a224-8d0511b8cbb9 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:28.923404 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fec08-5592-4b1b-a224-8d0511b8cbb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:28.923706 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fec08-5592-4b1b-a224-8d0511b8cbb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:28.925113 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fec08-5592-4b1b-a224-8d0511b8cbb9 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:28.936399 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 254/510] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:28.937212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fec08-5592-4b1b-a224-8d0511b8cbb9 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:28.965442 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:28.980894 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 257/511] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:28.981732 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b133ad-3b0e-4a3e-85a0-003949109d8c None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:29.029370 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:29.039636 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fec08-5592-4b1b-a224-8d0511b8cbb9 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:29.073090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ac167-d954-450e-b291-af89bdf57bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:29.073684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ac167-d954-450e-b291-af89bdf57bfd None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:29.073959 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ac167-d954-450e-b291-af89bdf57bfd None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:29.074226 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ac167-d954-450e-b291-af89bdf57bfd None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:29.074854 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ac167-d954-450e-b291-af89bdf57bfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:29.075151 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ac167-d954-450e-b291-af89bdf57bfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:29.076564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ac167-d954-450e-b291-af89bdf57bfd None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:29.081765 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b133ad-3b0e-4a3e-85a0-003949109d8c None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:29.088170 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 255/512] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:29.092805 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ac167-d954-450e-b291-af89bdf57bfd None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:29.115195 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc1bab-f1ae-4e1c-8c40-93bfc73ef4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:29.115811 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc1bab-f1ae-4e1c-8c40-93bfc73ef4ed None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:29.116086 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc1bab-f1ae-4e1c-8c40-93bfc73ef4ed None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:29.116355 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc1bab-f1ae-4e1c-8c40-93bfc73ef4ed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:29.124277 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc1bab-f1ae-4e1c-8c40-93bfc73ef4ed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:29.125753 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc1bab-f1ae-4e1c-8c40-93bfc73ef4ed None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-01bc1bab-f1ae-4e1c-8c40-93bfc73ef4ed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:29.137786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:29.138780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:29.139668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:29.139668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:29.139668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:29.139668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:29.139668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:29.139668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:29.139668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:29.139668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:29.139668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 17:27:29.139668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:29.139668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 258/513] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:29.139668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc1bab-f1ae-4e1c-8c40-93bfc73ef4ed None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:29.178132 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:29.190029 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ac167-d954-450e-b291-af89bdf57bfd None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:29.223554 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f23b6-97bc-4753-8d7e-14f89d6b7be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:29.224179 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f23b6-97bc-4753-8d7e-14f89d6b7be5 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:29.224455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f23b6-97bc-4753-8d7e-14f89d6b7be5 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:29.224747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f23b6-97bc-4753-8d7e-14f89d6b7be5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:29.231373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f23b6-97bc-4753-8d7e-14f89d6b7be5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:29.232839 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f23b6-97bc-4753-8d7e-14f89d6b7be5 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:29.239137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc1bab-f1ae-4e1c-8c40-93bfc73ef4ed None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-990f23b6-97bc-4753-8d7e-14f89d6b7be5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:29.244778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:29.245782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:29.246988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:29.246988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:29.246988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:29.246988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:29.246988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:29.246988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:29.246988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:29.246988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:29.247694 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 256/514] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:29.248496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f23b6-97bc-4753-8d7e-14f89d6b7be5 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:29.249115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:29.274516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639830-9943-49d6-a11f-c55240680fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:29.275130 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639830-9943-49d6-a11f-c55240680fb4 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:29.275406 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639830-9943-49d6-a11f-c55240680fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:29.275677 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61639830-9943-49d6-a11f-c55240680fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:29.286726 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61639830-9943-49d6-a11f-c55240680fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:29.288166 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61639830-9943-49d6-a11f-c55240680fb4 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-61639830-9943-49d6-a11f-c55240680fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:29.301943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:29.303016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:29.303854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:29.303854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:29.303854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:29.303854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 259/515] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:29.304081 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639830-9943-49d6-a11f-c55240680fb4 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:29.357485 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f23b6-97bc-4753-8d7e-14f89d6b7be5 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:29.391294 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db1c5f-b42f-49fa-8e86-d9321a83610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:29.391844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db1c5f-b42f-49fa-8e86-d9321a83610e None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:29.392121 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db1c5f-b42f-49fa-8e86-d9321a83610e None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:29.392387 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db1c5f-b42f-49fa-8e86-d9321a83610e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:29.398780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db1c5f-b42f-49fa-8e86-d9321a83610e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:29.400253 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db1c5f-b42f-49fa-8e86-d9321a83610e None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:29.402470 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61639830-9943-49d6-a11f-c55240680fb4 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-96db1c5f-b42f-49fa-8e86-d9321a83610e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:29.410954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:29.411780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:29.412630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:29.412630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:29.412630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:29.412630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:29.412630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:29.412630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:29.412630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:29.412630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:29.412630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 257/516] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:29.413132 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db1c5f-b42f-49fa-8e86-d9321a83610e None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:29.425664 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:29.446250 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37bfe9-a973-49ae-95b0-7581c3c02ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:29.446849 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37bfe9-a973-49ae-95b0-7581c3c02ee2 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:29.447130 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37bfe9-a973-49ae-95b0-7581c3c02ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:29.447403 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37bfe9-a973-49ae-95b0-7581c3c02ee2 None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:29.448126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37bfe9-a973-49ae-95b0-7581c3c02ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:29.448432 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37bfe9-a973-49ae-95b0-7581c3c02ee2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:29.449909 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37bfe9-a973-49ae-95b0-7581c3c02ee2 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:29.466772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 260/517] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Aug 19 17:27:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:29.467561 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37bfe9-a973-49ae-95b0-7581c3c02ee2 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:29.487410 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:29.513281 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db1c5f-b42f-49fa-8e86-d9321a83610e None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:29.547789 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fbf30-4032-4929-8c8c-a3140c34fa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:29.548387 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fbf30-4032-4929-8c8c-a3140c34fa86 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:29.548667 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fbf30-4032-4929-8c8c-a3140c34fa86 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:29.548968 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fbf30-4032-4929-8c8c-a3140c34fa86 None admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:29.549648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fbf30-4032-4929-8c8c-a3140c34fa86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:29.549953 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fbf30-4032-4929-8c8c-a3140c34fa86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:29.551385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fbf30-4032-4929-8c8c-a3140c34fa86 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:29.566682 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37bfe9-a973-49ae-95b0-7581c3c02ee2 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:29.569555 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 258/518] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:29.570359 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fbf30-4032-4929-8c8c-a3140c34fa86 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:29.600699 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2b933-bd5c-4967-a220-1506db98dbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:29.601325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2b933-bd5c-4967-a220-1506db98dbb2 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:29.601600 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2b933-bd5c-4967-a220-1506db98dbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:29.601869 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2b933-bd5c-4967-a220-1506db98dbb2 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:29.602498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2b933-bd5c-4967-a220-1506db98dbb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:29.602798 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2b933-bd5c-4967-a220-1506db98dbb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:29.604765 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2b933-bd5c-4967-a220-1506db98dbb2 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:29.615713 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 261/519] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:29.616499 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2b933-bd5c-4967-a220-1506db98dbb2 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:29.644245 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:29.678220 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fbf30-4032-4929-8c8c-a3140c34fa86 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:29.699618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:29.711744 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37678e9-688d-45be-8330-3514ea680198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:29.712339 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37678e9-688d-45be-8330-3514ea680198 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:29.713169 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37678e9-688d-45be-8330-3514ea680198 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:29.713440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37678e9-688d-45be-8330-3514ea680198 None admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:29.714112 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37678e9-688d-45be-8330-3514ea680198 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:29.714413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37678e9-688d-45be-8330-3514ea680198 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:29.715824 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37678e9-688d-45be-8330-3514ea680198 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:29.720680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2b933-bd5c-4967-a220-1506db98dbb2 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:29.727556 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 259/520] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:29.728915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37678e9-688d-45be-8330-3514ea680198 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:29.755041 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74955d0b-9818-4416-b09d-8c747f1d41fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:29.755625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74955d0b-9818-4416-b09d-8c747f1d41fb None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:29.755900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74955d0b-9818-4416-b09d-8c747f1d41fb None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:29.756171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74955d0b-9818-4416-b09d-8c747f1d41fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:29.821309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74955d0b-9818-4416-b09d-8c747f1d41fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:29.822799 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74955d0b-9818-4416-b09d-8c747f1d41fb None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:29.825131 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37678e9-688d-45be-8330-3514ea680198 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:29.858076 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:29.865669 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028414b-2492-47cb-8df8-aec218abf543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:29.866290 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028414b-2492-47cb-8df8-aec218abf543 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:29.866572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028414b-2492-47cb-8df8-aec218abf543 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:29.871043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028414b-2492-47cb-8df8-aec218abf543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:29.871043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028414b-2492-47cb-8df8-aec218abf543 None admin] RBAC: Adding query filter params (role.id=80dbe26dc5454ef49e2feba96589b473, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=fb1c954936f64051b09afba8df544ec7) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:29.871043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028414b-2492-47cb-8df8-aec218abf543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:29.871043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028414b-2492-47cb-8df8-aec218abf543 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:29.875078 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 260/521] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:27:29 2022] GET /identity/v3/role_assignments?user.id=fb1c954936f64051b09afba8df544ec7&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=80dbe26dc5454ef49e2feba96589b473 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:29.875849 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028414b-2492-47cb-8df8-aec218abf543 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:29.922515 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:29.947175 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 262/522] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:29.948047 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74955d0b-9818-4416-b09d-8c747f1d41fb None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:30.004642 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028414b-2492-47cb-8df8-aec218abf543 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:30.044436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490e1d6-a479-4e06-901a-d97a7ad13c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:30.045116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490e1d6-a479-4e06-901a-d97a7ad13c38 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:30.045398 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490e1d6-a479-4e06-901a-d97a7ad13c38 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:30.045786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490e1d6-a479-4e06-901a-d97a7ad13c38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:30.053344 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490e1d6-a479-4e06-901a-d97a7ad13c38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:30.056756 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490e1d6-a479-4e06-901a-d97a7ad13c38 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:30.064082 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74955d0b-9818-4416-b09d-8c747f1d41fb None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-5490e1d6-a479-4e06-901a-d97a7ad13c38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:30.067128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:30.072705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:30.073573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:30.073573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:30.073573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:30.073573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:30.073573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:30.073573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:30.073573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:30.073573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:30.073573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 261/523] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:30.073573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490e1d6-a479-4e06-901a-d97a7ad13c38 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:30.112137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b07a77-950a-4063-a6a0-7faa72cae576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:30.112750 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b07a77-950a-4063-a6a0-7faa72cae576 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:30.113132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b07a77-950a-4063-a6a0-7faa72cae576 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:30.113408 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b07a77-950a-4063-a6a0-7faa72cae576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:30.114132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b07a77-950a-4063-a6a0-7faa72cae576 None admin] RBAC: Adding query filter params (role.id=80dbe26dc5454ef49e2feba96589b473, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=fbe5b4476e8e413f8d409c8e73c4c4f4) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:30.114448 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b07a77-950a-4063-a6a0-7faa72cae576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:30.115912 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b07a77-950a-4063-a6a0-7faa72cae576 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:30.132754 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 263/524] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:27:29 2022] GET /identity/v3/role_assignments?user.id=fbe5b4476e8e413f8d409c8e73c4c4f4&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=80dbe26dc5454ef49e2feba96589b473 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:30.132754 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b07a77-950a-4063-a6a0-7faa72cae576 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:30.154879 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:30.201235 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:30.229159 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490e1d6-a479-4e06-901a-d97a7ad13c38 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:30.241257 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b07a77-950a-4063-a6a0-7faa72cae576 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:30.289324 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22acf05-2d43-4ef5-afed-32b4c0c2e633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:30.290980 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22acf05-2d43-4ef5-afed-32b4c0c2e633 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:30.291457 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22acf05-2d43-4ef5-afed-32b4c0c2e633 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:30.291937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22acf05-2d43-4ef5-afed-32b4c0c2e633 None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:30.292088 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e1f9b-1add-4d0b-b4d4-3b97210b1c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:30.292731 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e1f9b-1add-4d0b-b4d4-3b97210b1c52 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:30.293030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e1f9b-1add-4d0b-b4d4-3b97210b1c52 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:30.293300 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e1f9b-1add-4d0b-b4d4-3b97210b1c52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:30.293586 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22acf05-2d43-4ef5-afed-32b4c0c2e633 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:30.294098 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22acf05-2d43-4ef5-afed-32b4c0c2e633 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:30.296024 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22acf05-2d43-4ef5-afed-32b4c0c2e633 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:30.306846 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e1f9b-1add-4d0b-b4d4-3b97210b1c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:30.308345 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e1f9b-1add-4d0b-b4d4-3b97210b1c52 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:30.320707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 264/525] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-fe1e1f9b-1add-4d0b-b4d4-3b97210b1c52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:30.325000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:30.325958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:30.326810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:30.326810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:30.326810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:30.326810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 262/526] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:30.328164 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22acf05-2d43-4ef5-afed-32b4c0c2e633 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:30.331721 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e1f9b-1add-4d0b-b4d4-3b97210b1c52 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:30.443625 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e1f9b-1add-4d0b-b4d4-3b97210b1c52 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:30.446105 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:30.467524 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22acf05-2d43-4ef5-afed-32b4c0c2e633 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:30.467524 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:30.481559 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac70f0-a01d-47b4-a673-39d023dab734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:30.482586 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac70f0-a01d-47b4-a673-39d023dab734 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:30.483066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac70f0-a01d-47b4-a673-39d023dab734 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:30.483526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac70f0-a01d-47b4-a673-39d023dab734 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:30.484374 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac70f0-a01d-47b4-a673-39d023dab734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:30.484884 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac70f0-a01d-47b4-a673-39d023dab734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:30.486526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac70f0-a01d-47b4-a673-39d023dab734 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:30.500533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 263/527] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:30.509008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978f0b8-8b34-4736-a658-86bf1126090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:30.509008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978f0b8-8b34-4736-a658-86bf1126090f None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:30.509008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978f0b8-8b34-4736-a658-86bf1126090f None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:30.509008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978f0b8-8b34-4736-a658-86bf1126090f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:30.509384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978f0b8-8b34-4736-a658-86bf1126090f None admin] RBAC: Adding query filter params (role.id=80dbe26dc5454ef49e2feba96589b473, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=c0d818956e1048a096830ec372382e7e) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:30.509384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978f0b8-8b34-4736-a658-86bf1126090f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:30.509384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978f0b8-8b34-4736-a658-86bf1126090f None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:30.509559 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac70f0-a01d-47b4-a673-39d023dab734 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:30.511564 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 265/528] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:27:30 2022] GET /identity/v3/role_assignments?user.id=c0d818956e1048a096830ec372382e7e&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=80dbe26dc5454ef49e2feba96589b473 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:30.624491 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac70f0-a01d-47b4-a673-39d023dab734 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:30.666967 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161e353-0f7b-4cd8-97d9-cf17856f28ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:30.667617 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161e353-0f7b-4cd8-97d9-cf17856f28ca None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:30.667894 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161e353-0f7b-4cd8-97d9-cf17856f28ca None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:30.668163 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161e353-0f7b-4cd8-97d9-cf17856f28ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:30.676262 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161e353-0f7b-4cd8-97d9-cf17856f28ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:30.677771 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161e353-0f7b-4cd8-97d9-cf17856f28ca None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-9161e353-0f7b-4cd8-97d9-cf17856f28ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:30.690523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:30.691433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:30.692497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:30.692497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:30.692497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:30.692497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:30.692497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:30.692497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:30.692497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:30.692497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:30.692497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 264/529] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:30.699026 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978f0b8-8b34-4736-a658-86bf1126090f None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:30.805695 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978f0b8-8b34-4736-a658-86bf1126090f None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:30.843971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d909fb3-6b27-4d07-a492-419e982c5e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:30.844577 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d909fb3-6b27-4d07-a492-419e982c5e91 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:30.844890 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d909fb3-6b27-4d07-a492-419e982c5e91 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:30.845162 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d909fb3-6b27-4d07-a492-419e982c5e91 None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:30.845850 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d909fb3-6b27-4d07-a492-419e982c5e91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:30.846158 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d909fb3-6b27-4d07-a492-419e982c5e91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:30.847599 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d909fb3-6b27-4d07-a492-419e982c5e91 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:30.859988 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 266/530] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:30.865976 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161e353-0f7b-4cd8-97d9-cf17856f28ca None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:30.892596 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:30.969337 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161e353-0f7b-4cd8-97d9-cf17856f28ca None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:31.004108 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebefed-1bf9-472e-91ea-d42f04009c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:31.005082 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebefed-1bf9-472e-91ea-d42f04009c34 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:31.005965 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebefed-1bf9-472e-91ea-d42f04009c34 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:31.006430 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebefed-1bf9-472e-91ea-d42f04009c34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:31.007354 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebefed-1bf9-472e-91ea-d42f04009c34 None admin] RBAC: Adding query filter params (role.id=80dbe26dc5454ef49e2feba96589b473, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=f21c562918c04d18aa0b01a3bdd4d6af) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:31.007854 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebefed-1bf9-472e-91ea-d42f04009c34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:31.010061 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eebefed-1bf9-472e-91ea-d42f04009c34 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:31.020847 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 265/531] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:27:30 2022] GET /identity/v3/role_assignments?user.id=f21c562918c04d18aa0b01a3bdd4d6af&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=80dbe26dc5454ef49e2feba96589b473 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:32.184528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5e7e0-268a-4057-a60c-d12f07a52290 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:32.185095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5e7e0-268a-4057-a60c-d12f07a52290 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:32.185095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5e7e0-268a-4057-a60c-d12f07a52290 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:32.186675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 267/532] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:32.191957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807895e-76f1-4e13-affc-4bb72f90463a None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:32.192339 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807895e-76f1-4e13-affc-4bb72f90463a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:32.192518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807895e-76f1-4e13-affc-4bb72f90463a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:32.210693 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-8807895e-76f1-4e13-affc-4bb72f90463a None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:32.211883 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-8807895e-76f1-4e13-affc-4bb72f90463a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:32.288687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 266/533] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:32.401151 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb14e5d-2f67-4786-95fa-6afddc45e510 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:32.401505 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb14e5d-2f67-4786-95fa-6afddc45e510 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:32.401707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb14e5d-2f67-4786-95fa-6afddc45e510 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:32.403297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 268/534] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:32.409165 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1976ec-e36c-4a69-91d7-b246f61d5a61 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:32.409682 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1976ec-e36c-4a69-91d7-b246f61d5a61 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:32.410164 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1976ec-e36c-4a69-91d7-b246f61d5a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:32.432106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-9f1976ec-e36c-4a69-91d7-b246f61d5a61 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:32.433436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-9f1976ec-e36c-4a69-91d7-b246f61d5a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:32.447585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:32.501934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 267/535] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:27:32.620851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb14e5d-2f67-4786-95fa-6afddc45e510 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:32.651178 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:32.730861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb14e5d-2f67-4786-95fa-6afddc45e510 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:32.768042 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abbb5f-d26f-4580-ba69-d0cd8d24eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:32.768675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abbb5f-d26f-4580-ba69-d0cd8d24eda5 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:32.768986 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abbb5f-d26f-4580-ba69-d0cd8d24eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:32.769257 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abbb5f-d26f-4580-ba69-d0cd8d24eda5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:32.782524 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abbb5f-d26f-4580-ba69-d0cd8d24eda5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-94abbb5f-d26f-4580-ba69-d0cd8d24eda5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:32.787309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:32.788227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:32.789094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:32.789094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:32.789094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:32.789094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:32.789094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:32.789094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:32.789094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:32.789094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:32.789094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:32.789094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:32.789094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:32.789094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:32.789729 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd631ad-3ea7-42f4-9827-dcb494149d0d None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:32.789729 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd631ad-3ea7-42f4-9827-dcb494149d0d None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:32.789729 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd631ad-3ea7-42f4-9827-dcb494149d0d None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:32.789933 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 269/536] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:32.790005 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 268/537] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:27:32.795252 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b7810-427e-41af-ac84-a861b9c210e0 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:32.795538 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b7810-427e-41af-ac84-a861b9c210e0 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:32.795815 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b7810-427e-41af-ac84-a861b9c210e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:32.796716 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd631ad-3ea7-42f4-9827-dcb494149d0d None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:32.813952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-2e8b7810-427e-41af-ac84-a861b9c210e0 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:32.815163 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-2e8b7810-427e-41af-ac84-a861b9c210e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:32.885253 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 270/538] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:32.889692 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b7810-427e-41af-ac84-a861b9c210e0 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:32.909799 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:32.910155 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd631ad-3ea7-42f4-9827-dcb494149d0d None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:32.946271 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227c31f-459e-41e2-8782-33a6f02e0c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:32.947320 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227c31f-459e-41e2-8782-33a6f02e0c15 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:32.948044 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227c31f-459e-41e2-8782-33a6f02e0c15 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:32.948535 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227c31f-459e-41e2-8782-33a6f02e0c15 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:32.949418 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227c31f-459e-41e2-8782-33a6f02e0c15 None admin] RBAC: Adding query filter params (name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:32.949939 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227c31f-459e-41e2-8782-33a6f02e0c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:32.951529 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227c31f-459e-41e2-8782-33a6f02e0c15 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:32.967920 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 269/539] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:27:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:32.969135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227c31f-459e-41e2-8782-33a6f02e0c15 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:32.982846 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:32.998717 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b7810-427e-41af-ac84-a861b9c210e0 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:33.035700 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d247b6-4663-4936-a0bf-8568d27cddb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:33.036356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d247b6-4663-4936-a0bf-8568d27cddb0 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.036637 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d247b6-4663-4936-a0bf-8568d27cddb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.036927 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d247b6-4663-4936-a0bf-8568d27cddb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.048205 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d247b6-4663-4936-a0bf-8568d27cddb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-c5d247b6-4663-4936-a0bf-8568d27cddb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:33.053143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:33.054034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:33.054831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:33.054831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:33.054831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:33.054831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:33.054831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:33.054831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:33.054831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:33.054831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:33.054831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:33.054831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:33.054831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:33.054831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:33.059183 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 271/540] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:33.060468 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d247b6-4663-4936-a0bf-8568d27cddb0 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:33.080111 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227c31f-459e-41e2-8782-33a6f02e0c15 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:33.119952 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531eb56d-fe53-4951-9103-a3b26b8436c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:33.120991 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531eb56d-fe53-4951-9103-a3b26b8436c5 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.121467 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531eb56d-fe53-4951-9103-a3b26b8436c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.121934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531eb56d-fe53-4951-9103-a3b26b8436c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.133492 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531eb56d-fe53-4951-9103-a3b26b8436c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:33.135682 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531eb56d-fe53-4951-9103-a3b26b8436c5 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-531eb56d-fe53-4951-9103-a3b26b8436c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:33.151322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:33.152333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:33.153238 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:33.153238 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:33.153238 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:33.159653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 270/541] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:33.160699 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531eb56d-fe53-4951-9103-a3b26b8436c5 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:33.163713 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:33.175353 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d247b6-4663-4936-a0bf-8568d27cddb0 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:33.212952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373859b-c4e4-4018-aedb-00ebe5d71368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:33.213657 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373859b-c4e4-4018-aedb-00ebe5d71368 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.214057 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373859b-c4e4-4018-aedb-00ebe5d71368 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.214425 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373859b-c4e4-4018-aedb-00ebe5d71368 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.215170 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373859b-c4e4-4018-aedb-00ebe5d71368 None admin] RBAC: Adding query filter params (name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:33.215563 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373859b-c4e4-4018-aedb-00ebe5d71368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:33.217040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373859b-c4e4-4018-aedb-00ebe5d71368 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:33.228810 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 272/542] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:27:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:33.229895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373859b-c4e4-4018-aedb-00ebe5d71368 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:33.235072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:33.274688 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531eb56d-fe53-4951-9103-a3b26b8436c5 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:33.308061 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da715ecb-be0f-4724-9944-366164278611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:33.308607 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da715ecb-be0f-4724-9944-366164278611 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.308931 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da715ecb-be0f-4724-9944-366164278611 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.309201 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da715ecb-be0f-4724-9944-366164278611 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.309828 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da715ecb-be0f-4724-9944-366164278611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:33.310127 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da715ecb-be0f-4724-9944-366164278611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:33.311501 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da715ecb-be0f-4724-9944-366164278611 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:33.323302 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 271/543] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:33.324074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da715ecb-be0f-4724-9944-366164278611 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:33.334357 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373859b-c4e4-4018-aedb-00ebe5d71368 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:33.368339 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ba513-c771-4b65-b01c-41f9f83d8ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:33.369008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ba513-c771-4b65-b01c-41f9f83d8ae3 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.369290 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ba513-c771-4b65-b01c-41f9f83d8ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.369559 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ba513-c771-4b65-b01c-41f9f83d8ae3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.376330 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:33.380896 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ba513-c771-4b65-b01c-41f9f83d8ae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-1b2ba513-c771-4b65-b01c-41f9f83d8ae3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:33.386191 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:33.387552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:33.388361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 273/544] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:33.389088 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ee0fe-6324-4086-9c4f-9cbb4e8d47e3 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.389088 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ee0fe-6324-4086-9c4f-9cbb4e8d47e3 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.389088 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ee0fe-6324-4086-9c4f-9cbb4e8d47e3 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.390187 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 274/545] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:33.390875 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ee0fe-6324-4086-9c4f-9cbb4e8d47e3 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:33.432572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da715ecb-be0f-4724-9944-366164278611 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:33.455458 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:33.467066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f51cd-24d3-44cf-b11a-cc193a3af59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:33.467692 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f51cd-24d3-44cf-b11a-cc193a3af59f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.467970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f51cd-24d3-44cf-b11a-cc193a3af59f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.468238 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f51cd-24d3-44cf-b11a-cc193a3af59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.478020 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f51cd-24d3-44cf-b11a-cc193a3af59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:33.480095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f51cd-24d3-44cf-b11a-cc193a3af59f None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-2e3f51cd-24d3-44cf-b11a-cc193a3af59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:33.494705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:33.495788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:33.496630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:33.496630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:33.496630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:33.496630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 272/546] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:33.496893 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f51cd-24d3-44cf-b11a-cc193a3af59f None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:33.504922 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ee0fe-6324-4086-9c4f-9cbb4e8d47e3 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:33.538033 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad7822-4ff8-4213-a06f-e3abc7d53ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:33.538645 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7822-4ff8-4213-a06f-e3abc7d53ae0 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.538921 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7822-4ff8-4213-a06f-e3abc7d53ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.539196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7822-4ff8-4213-a06f-e3abc7d53ae0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.547257 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad7822-4ff8-4213-a06f-e3abc7d53ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:33.548716 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad7822-4ff8-4213-a06f-e3abc7d53ae0 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-6bad7822-4ff8-4213-a06f-e3abc7d53ae0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:33.559504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:33.564874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 275/547] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 19 17:27:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b270c-15f4-4280-bc9e-f713eee95583 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.565858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b270c-15f4-4280-bc9e-f713eee95583 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.566625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b270c-15f4-4280-bc9e-f713eee95583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.581047 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-cf2b270c-15f4-4280-bc9e-f713eee95583 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:33.582288 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-cf2b270c-15f4-4280-bc9e-f713eee95583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:33.600747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f51cd-24d3-44cf-b11a-cc193a3af59f None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:33.634981 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a76dc-1f2e-492c-9bfa-cb4bd00a3048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:33.635588 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a76dc-1f2e-492c-9bfa-cb4bd00a3048 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.635891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a76dc-1f2e-492c-9bfa-cb4bd00a3048 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.636147 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a76dc-1f2e-492c-9bfa-cb4bd00a3048 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.636414 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:33.636919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a76dc-1f2e-492c-9bfa-cb4bd00a3048 None admin] RBAC: Adding query filter params (name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:33.637229 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a76dc-1f2e-492c-9bfa-cb4bd00a3048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:33.638594 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a76dc-1f2e-492c-9bfa-cb4bd00a3048 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:33.646599 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 273/548] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:27:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:33.647428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a76dc-1f2e-492c-9bfa-cb4bd00a3048 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:33.654982 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 276/549] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:33.657801 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b270c-15f4-4280-bc9e-f713eee95583 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:33.688860 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:33.757400 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a76dc-1f2e-492c-9bfa-cb4bd00a3048 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:33.773778 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b270c-15f4-4280-bc9e-f713eee95583 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:33.800337 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9a66-1533-4f41-a451-2852adcfefc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:33.800986 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9a66-1533-4f41-a451-2852adcfefc9 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.801269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9a66-1533-4f41-a451-2852adcfefc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.801540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9a66-1533-4f41-a451-2852adcfefc9 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.802344 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e9a66-1533-4f41-a451-2852adcfefc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:33.802647 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e9a66-1533-4f41-a451-2852adcfefc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:33.804138 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e9a66-1533-4f41-a451-2852adcfefc9 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:33.808320 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3f842-09c9-4872-b4b8-6acd78f375c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:33.808942 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3f842-09c9-4872-b4b8-6acd78f375c2 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.809217 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3f842-09c9-4872-b4b8-6acd78f375c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.809483 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3f842-09c9-4872-b4b8-6acd78f375c2 None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.810194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3f842-09c9-4872-b4b8-6acd78f375c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:33.810491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3f842-09c9-4872-b4b8-6acd78f375c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:33.811968 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3f842-09c9-4872-b4b8-6acd78f375c2 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:33.822486 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 274/550] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:33.823359 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9a66-1533-4f41-a451-2852adcfefc9 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:33.829832 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 277/551] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 19 17:27:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:33.834903 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3f842-09c9-4872-b4b8-6acd78f375c2 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:33.883884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:33.920361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:33.927964 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9a66-1533-4f41-a451-2852adcfefc9 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:33.939209 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3f842-09c9-4872-b4b8-6acd78f375c2 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:33.962200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2dd2c-d931-4d73-a854-026e0462ae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:33.962861 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2dd2c-d931-4d73-a854-026e0462ae71 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.963399 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2dd2c-d931-4d73-a854-026e0462ae71 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.963399 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2dd2c-d931-4d73-a854-026e0462ae71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.973786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2dd2c-d931-4d73-a854-026e0462ae71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:33.973908 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa961ae-e816-469c-8506-1bbd2d82f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:33.974436 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa961ae-e816-469c-8506-1bbd2d82f781 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:33.974711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa961ae-e816-469c-8506-1bbd2d82f781 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:33.974975 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa961ae-e816-469c-8506-1bbd2d82f781 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:33.975277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2dd2c-d931-4d73-a854-026e0462ae71 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:33.983373 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa961ae-e816-469c-8506-1bbd2d82f781 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:33.984876 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa961ae-e816-469c-8506-1bbd2d82f781 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-9bd2dd2c-d931-4d73-a854-026e0462ae71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:33.991782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:33.999095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:34.000301 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:34.000301 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:34.000301 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:34.000301 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 275/552] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:34.000301 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2dd2c-d931-4d73-a854-026e0462ae71 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-3aa961ae-e816-469c-8506-1bbd2d82f781 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:34.000797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:34.001652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:34.002711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:34.002711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:34.002711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:34.002711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:34.002711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:34.002711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:34.002711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:34.002711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:34.002711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 17:27:34.002711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:34.002711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 278/553] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:34.002711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa961ae-e816-469c-8506-1bbd2d82f781 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.100057 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2dd2c-d931-4d73-a854-026e0462ae71 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:34.110371 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa961ae-e816-469c-8506-1bbd2d82f781 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:34.117661 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:34.132224 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbefb93-2419-47a0-900e-23e3207b2f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:34.132875 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbefb93-2419-47a0-900e-23e3207b2f6d None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:34.133155 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbefb93-2419-47a0-900e-23e3207b2f6d None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:34.133426 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbefb93-2419-47a0-900e-23e3207b2f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:34.145134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbefb93-2419-47a0-900e-23e3207b2f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:34.145619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb28ff4-6ccb-4005-a77d-335c10f4ade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:34.146239 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb28ff4-6ccb-4005-a77d-335c10f4ade3 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:34.146517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb28ff4-6ccb-4005-a77d-335c10f4ade3 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:34.146620 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbefb93-2419-47a0-900e-23e3207b2f6d None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:34.146789 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb28ff4-6ccb-4005-a77d-335c10f4ade3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:34.154914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:34.163376 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb28ff4-6ccb-4005-a77d-335c10f4ade3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-6fbefb93-2419-47a0-900e-23e3207b2f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:34.166508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:34.168056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:34.169072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:34.169072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:34.169072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:34.169072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 276/554] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:34.169830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbefb93-2419-47a0-900e-23e3207b2f6d None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-0fb28ff4-6ccb-4005-a77d-335c10f4ade3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:34.169955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:34.170787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 279/555] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:34.173079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb28ff4-6ccb-4005-a77d-335c10f4ade3 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.271897 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb28ff4-6ccb-4005-a77d-335c10f4ade3 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:34.272553 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbefb93-2419-47a0-900e-23e3207b2f6d None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:34.304576 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05a4db-deab-4a60-8186-48dc55463fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:34.304775 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d9003-9f16-496a-8ef3-c6973a6c3c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:34.305239 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05a4db-deab-4a60-8186-48dc55463fda None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:34.305343 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d9003-9f16-496a-8ef3-c6973a6c3c55 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:34.305511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d9003-9f16-496a-8ef3-c6973a6c3c55 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:34.305683 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05a4db-deab-4a60-8186-48dc55463fda None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:34.305776 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d9003-9f16-496a-8ef3-c6973a6c3c55 None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:34.305865 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05a4db-deab-4a60-8186-48dc55463fda None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:34.306901 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05a4db-deab-4a60-8186-48dc55463fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:34.307005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d9003-9f16-496a-8ef3-c6973a6c3c55 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:34.307198 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05a4db-deab-4a60-8186-48dc55463fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:34.307297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d9003-9f16-496a-8ef3-c6973a6c3c55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:34.308558 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05a4db-deab-4a60-8186-48dc55463fda None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:34.308662 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d9003-9f16-496a-8ef3-c6973a6c3c55 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:34.320019 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 277/556] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:34.320825 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05a4db-deab-4a60-8186-48dc55463fda None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.325214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 280/557] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 19 17:27:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:34.325999 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d9003-9f16-496a-8ef3-c6973a6c3c55 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.355620 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:34.394239 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:34.435009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05a4db-deab-4a60-8186-48dc55463fda None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:34.435178 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d9003-9f16-496a-8ef3-c6973a6c3c55 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:34.467878 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce5181-4025-4a32-ad17-028d53aad8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:34.468472 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce5181-4025-4a32-ad17-028d53aad8c8 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:34.468773 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce5181-4025-4a32-ad17-028d53aad8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:34.469050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce5181-4025-4a32-ad17-028d53aad8c8 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:34.469679 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce5181-4025-4a32-ad17-028d53aad8c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:34.469977 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce5181-4025-4a32-ad17-028d53aad8c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:34.470369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e1f61-e468-4137-8089-763df22afc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:34.471054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e1f61-e468-4137-8089-763df22afc92 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:34.471328 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce5181-4025-4a32-ad17-028d53aad8c8 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:34.471422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e1f61-e468-4137-8089-763df22afc92 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:34.471752 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e1f61-e468-4137-8089-763df22afc92 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:34.472468 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e1f61-e468-4137-8089-763df22afc92 None admin] RBAC: Adding query filter params (name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:34.472798 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e1f61-e468-4137-8089-763df22afc92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:34.474132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e1f61-e468-4137-8089-763df22afc92 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:34.482366 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 281/558] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:27:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:34.486792 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 278/559] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:34.486936 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e1f61-e468-4137-8089-763df22afc92 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.487025 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce5181-4025-4a32-ad17-028d53aad8c8 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.569583 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:34.581247 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce5181-4025-4a32-ad17-028d53aad8c8 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:34.584548 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e1f61-e468-4137-8089-763df22afc92 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:34.601020 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:34.614755 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e5687-65d7-43ed-a481-eeb24a2b45fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:34.615468 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e5687-65d7-43ed-a481-eeb24a2b45fc None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:34.615751 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e5687-65d7-43ed-a481-eeb24a2b45fc None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:34.616019 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e5687-65d7-43ed-a481-eeb24a2b45fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:34.618376 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f69d-efce-4102-8370-593afd292bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:34.619014 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f69d-efce-4102-8370-593afd292bd7 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:34.619288 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f69d-efce-4102-8370-593afd292bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:34.619555 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f69d-efce-4102-8370-593afd292bd7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:34.626415 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e5687-65d7-43ed-a481-eeb24a2b45fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:34.627246 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f69d-efce-4102-8370-593afd292bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:34.627854 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e5687-65d7-43ed-a481-eeb24a2b45fc None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:34.628661 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f69d-efce-4102-8370-593afd292bd7 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-7f04f69d-efce-4102-8370-593afd292bd7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:34.641055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:34.642182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:34.643867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:34.643867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:34.643867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:34.643867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:34.643867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:34.643867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:34.643867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:34.643867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:34.643867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:27:34.643867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:34.643867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 282/560] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:34.643867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f69d-efce-4102-8370-593afd292bd7 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-c12e5687-65d7-43ed-a481-eeb24a2b45fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:34.646994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:34.648089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:34.649094 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:34.649094 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:34.649094 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:34.652789 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 279/561] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:34.653483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e5687-65d7-43ed-a481-eeb24a2b45fc None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.741337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f69d-efce-4102-8370-593afd292bd7 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:34.753229 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e5687-65d7-43ed-a481-eeb24a2b45fc None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:34.774072 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e767ae4-ab4e-4caf-aa1e-f3407fd82837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:34.774678 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e767ae4-ab4e-4caf-aa1e-f3407fd82837 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:34.775000 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e767ae4-ab4e-4caf-aa1e-f3407fd82837 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:34.775268 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e767ae4-ab4e-4caf-aa1e-f3407fd82837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:34.785990 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7b73-e4d9-4d07-8c0d-587ab320bf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:34.786250 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e767ae4-ab4e-4caf-aa1e-f3407fd82837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:34.786605 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7b73-e4d9-4d07-8c0d-587ab320bf3a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:34.786881 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7b73-e4d9-4d07-8c0d-587ab320bf3a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:34.787155 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7b73-e4d9-4d07-8c0d-587ab320bf3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:34.787744 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e767ae4-ab4e-4caf-aa1e-f3407fd82837 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:34.794654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af7b73-e4d9-4d07-8c0d-587ab320bf3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:34.795107 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:34.796086 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af7b73-e4d9-4d07-8c0d-587ab320bf3a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-9e767ae4-ab4e-4caf-aa1e-f3407fd82837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:34.803379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:34.811133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:34.812226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:34.812226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:34.812226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:34.812226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 283/562] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:34.812226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e767ae4-ab4e-4caf-aa1e-f3407fd82837 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-55af7b73-e4d9-4d07-8c0d-587ab320bf3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:34.812585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:34.813522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:34.814819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:34.814819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:34.814819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:34.814819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:34.814819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:34.814819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:34.814819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:34.814819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:34.814819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 280/563] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:34.814819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7b73-e4d9-4d07-8c0d-587ab320bf3a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.843528 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:34.907915 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e767ae4-ab4e-4caf-aa1e-f3407fd82837 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:34.911230 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7b73-e4d9-4d07-8c0d-587ab320bf3a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:34.941156 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc79f2c-086b-4852-b946-08f5aadbfd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:34.941752 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc79f2c-086b-4852-b946-08f5aadbfd21 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:34.942025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc79f2c-086b-4852-b946-08f5aadbfd21 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:34.942294 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc79f2c-086b-4852-b946-08f5aadbfd21 None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:34.943001 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc79f2c-086b-4852-b946-08f5aadbfd21 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:34.943300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc79f2c-086b-4852-b946-08f5aadbfd21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:34.944478 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7aa4f0-f192-4efd-90db-8fb3bb2d8eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:34.944744 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc79f2c-086b-4852-b946-08f5aadbfd21 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:34.945099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aa4f0-f192-4efd-90db-8fb3bb2d8eff None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:34.945380 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aa4f0-f192-4efd-90db-8fb3bb2d8eff None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:34.945650 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aa4f0-f192-4efd-90db-8fb3bb2d8eff None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:34.946282 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7aa4f0-f192-4efd-90db-8fb3bb2d8eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:34.946580 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7aa4f0-f192-4efd-90db-8fb3bb2d8eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:34.947944 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7aa4f0-f192-4efd-90db-8fb3bb2d8eff None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:34.959990 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 281/564] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:34.960792 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7aa4f0-f192-4efd-90db-8fb3bb2d8eff None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:34.966275 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 284/565] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 19 17:27:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:34.966275 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc79f2c-086b-4852-b946-08f5aadbfd21 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:35.018206 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:35.053102 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:35.061421 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc79f2c-086b-4852-b946-08f5aadbfd21 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:35.062141 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7aa4f0-f192-4efd-90db-8fb3bb2d8eff None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:35.096374 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196d06a-f17b-4a31-8c6d-95316dcff640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:35.097112 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196d06a-f17b-4a31-8c6d-95316dcff640 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:35.097456 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196d06a-f17b-4a31-8c6d-95316dcff640 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:35.097736 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196d06a-f17b-4a31-8c6d-95316dcff640 None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:35.098416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196d06a-f17b-4a31-8c6d-95316dcff640 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:35.098716 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196d06a-f17b-4a31-8c6d-95316dcff640 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:35.100125 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196d06a-f17b-4a31-8c6d-95316dcff640 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:35.100670 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d8faa-3370-4169-9bad-0e4e1c6b01b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:35.101290 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8faa-3370-4169-9bad-0e4e1c6b01b6 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:35.101567 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8faa-3370-4169-9bad-0e4e1c6b01b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:35.101835 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8faa-3370-4169-9bad-0e4e1c6b01b6 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:35.102465 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d8faa-3370-4169-9bad-0e4e1c6b01b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:35.102764 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d8faa-3370-4169-9bad-0e4e1c6b01b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:35.104181 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d8faa-3370-4169-9bad-0e4e1c6b01b6 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:35.111369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 285/566] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:35.112148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196d06a-f17b-4a31-8c6d-95316dcff640 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:35.124645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 282/567] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:35.124645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d8faa-3370-4169-9bad-0e4e1c6b01b6 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:35.209520 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196d06a-f17b-4a31-8c6d-95316dcff640 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:35.222203 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d8faa-3370-4169-9bad-0e4e1c6b01b6 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:35.225728 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:35.244261 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3f2b9-f639-47c0-b955-98f4114c399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:35.245066 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3f2b9-f639-47c0-b955-98f4114c399a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:35.245465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3f2b9-f639-47c0-b955-98f4114c399a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:35.245835 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3f2b9-f639-47c0-b955-98f4114c399a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:35.253125 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3f2b9-f639-47c0-b955-98f4114c399a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:35.254579 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3f2b9-f639-47c0-b955-98f4114c399a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:35.258642 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69598db-a3be-42df-9044-9b816a136700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:35.259893 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69598db-a3be-42df-9044-9b816a136700 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:35.260244 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69598db-a3be-42df-9044-9b816a136700 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:35.260516 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69598db-a3be-42df-9044-9b816a136700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-40b3f2b9-f639-47c0-b955-98f4114c399a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:35.267792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:35.268900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:35.269998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:35.269998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:35.269998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:35.269998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:35.269998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:35.269998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:35.269998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:35.269998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:35.269998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 286/568] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:35.272369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3f2b9-f639-47c0-b955-98f4114c399a None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:35.277625 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69598db-a3be-42df-9044-9b816a136700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:35.279088 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69598db-a3be-42df-9044-9b816a136700 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-f69598db-a3be-42df-9044-9b816a136700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:35.295050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:35.296004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:35.297690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:35.297690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:35.297690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:35.297690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 283/569] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:35.297690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69598db-a3be-42df-9044-9b816a136700 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:35.302092 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:35.394955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3f2b9-f639-47c0-b955-98f4114c399a None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:35.408580 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69598db-a3be-42df-9044-9b816a136700 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:35.433204 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6d457-6c84-4cde-8f30-8479e22e62af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:35.433965 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6d457-6c84-4cde-8f30-8479e22e62af None admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:35.434336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6d457-6c84-4cde-8f30-8479e22e62af None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:35.434698 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6d457-6c84-4cde-8f30-8479e22e62af None admin] PATH_INFO: `/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/fb1c954936f64051b09afba8df544ec7/roles/80dbe26dc5454ef49e2feba96589b473` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:35.448369 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec368cc6-4e07-443d-a43c-2119e1eb69d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:35.449136 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec368cc6-4e07-443d-a43c-2119e1eb69d0 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:35.449800 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec368cc6-4e07-443d-a43c-2119e1eb69d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:35.450152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec368cc6-4e07-443d-a43c-2119e1eb69d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:35.452568 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6d457-6c84-4cde-8f30-8479e22e62af None admin] RBAC: Authorizing `identity:create_grant(project_id=8b84e7b6ac1644538bb6ef2874a1f0cf, user_id=fb1c954936f64051b09afba8df544ec7, role_id=80dbe26dc5454ef49e2feba96589b473)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:35.454201 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6d457-6c84-4cde-8f30-8479e22e62af None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:35.459170 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec368cc6-4e07-443d-a43c-2119e1eb69d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:35.460781 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec368cc6-4e07-443d-a43c-2119e1eb69d0 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-ec368cc6-4e07-443d-a43c-2119e1eb69d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:35.471880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:35.473128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:35.474403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:35.474403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:35.474403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:35.474403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:35.474403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:35.474403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:35.474403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:35.474403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:35.474403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 17:27:35.474403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:35.474403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 284/570] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:35.474403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec368cc6-4e07-443d-a43c-2119e1eb69d0 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:35.530670 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 287/571] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:27:35 2022] PUT /identity/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/fb1c954936f64051b09afba8df544ec7/roles/80dbe26dc5454ef49e2feba96589b473 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:27:35.531648 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6d457-6c84-4cde-8f30-8479e22e62af None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:35.549387 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:35.563537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:35.595578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec368cc6-4e07-443d-a43c-2119e1eb69d0 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:35.640194 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0baef-817c-4045-9697-a38b6023f710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:35.641309 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0baef-817c-4045-9697-a38b6023f710 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:35.642041 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0baef-817c-4045-9697-a38b6023f710 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:35.642424 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0baef-817c-4045-9697-a38b6023f710 None admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:35.643391 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0baef-817c-4045-9697-a38b6023f710 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:35.643698 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0baef-817c-4045-9697-a38b6023f710 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:35.645975 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0baef-817c-4045-9697-a38b6023f710 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:35.651117 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6d457-6c84-4cde-8f30-8479e22e62af None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:35.667520 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 285/572] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:35.667520 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0baef-817c-4045-9697-a38b6023f710 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:35.690808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf871e-28e2-4b88-b9f2-45954802f26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:35.691679 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf871e-28e2-4b88-b9f2-45954802f26c None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:35.692066 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf871e-28e2-4b88-b9f2-45954802f26c None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:35.692429 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf871e-28e2-4b88-b9f2-45954802f26c None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:35.693279 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf871e-28e2-4b88-b9f2-45954802f26c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:35.693681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf871e-28e2-4b88-b9f2-45954802f26c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:35.695216 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf871e-28e2-4b88-b9f2-45954802f26c None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:35.712839 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 288/573] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:35.712839 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf871e-28e2-4b88-b9f2-45954802f26c None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:35.783354 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0baef-817c-4045-9697-a38b6023f710 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:35.807381 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:35.809296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:35.820972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b5ff6-4071-4505-ad8b-8c34a7956715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:35.821578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b5ff6-4071-4505-ad8b-8c34a7956715 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:35.821900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b5ff6-4071-4505-ad8b-8c34a7956715 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:35.822168 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b5ff6-4071-4505-ad8b-8c34a7956715 None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:35.822882 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b5ff6-4071-4505-ad8b-8c34a7956715 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:35.823179 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b5ff6-4071-4505-ad8b-8c34a7956715 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:35.823273 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf871e-28e2-4b88-b9f2-45954802f26c None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:35.824611 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b5ff6-4071-4505-ad8b-8c34a7956715 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:35.842888 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 286/574] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Aug 19 17:27:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:35.844075 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b5ff6-4071-4505-ad8b-8c34a7956715 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:35.864631 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898ee42-3283-4e3e-96de-615c3d11cc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:35.865482 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898ee42-3283-4e3e-96de-615c3d11cc9c None admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:35.865876 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898ee42-3283-4e3e-96de-615c3d11cc9c None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:35.866251 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898ee42-3283-4e3e-96de-615c3d11cc9c None admin] PATH_INFO: `/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/fbe5b4476e8e413f8d409c8e73c4c4f4/roles/80dbe26dc5454ef49e2feba96589b473` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:35.882045 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898ee42-3283-4e3e-96de-615c3d11cc9c None admin] RBAC: Authorizing `identity:create_grant(project_id=8b84e7b6ac1644538bb6ef2874a1f0cf, user_id=fbe5b4476e8e413f8d409c8e73c4c4f4, role_id=80dbe26dc5454ef49e2feba96589b473)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:35.883606 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898ee42-3283-4e3e-96de-615c3d11cc9c None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:35.945034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b5ff6-4071-4505-ad8b-8c34a7956715 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:35.956886 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 289/575] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:27:35 2022] PUT /identity/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/fbe5b4476e8e413f8d409c8e73c4c4f4/roles/80dbe26dc5454ef49e2feba96589b473 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:27:35.956886 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898ee42-3283-4e3e-96de-615c3d11cc9c None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:36.003113 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba4345-8121-4578-9a19-2db5d3016fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:36.004503 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba4345-8121-4578-9a19-2db5d3016fdc None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:36.004866 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba4345-8121-4578-9a19-2db5d3016fdc None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:36.005145 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba4345-8121-4578-9a19-2db5d3016fdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:36.017122 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba4345-8121-4578-9a19-2db5d3016fdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:36.018668 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba4345-8121-4578-9a19-2db5d3016fdc None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-4eba4345-8121-4578-9a19-2db5d3016fdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:36.036445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:36.037622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:36.038891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:36.038891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:36.038891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:36.038891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:36.038891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:36.038891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:36.038891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:36.038891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:36.038891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 287/576] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:36.044580 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba4345-8121-4578-9a19-2db5d3016fdc None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:36.082729 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898ee42-3283-4e3e-96de-615c3d11cc9c None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:36.101440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:36.130369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23f3a7-1e74-44ab-bf3b-91134bc9bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:36.131103 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23f3a7-1e74-44ab-bf3b-91134bc9bd93 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:36.131455 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23f3a7-1e74-44ab-bf3b-91134bc9bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:36.131795 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23f3a7-1e74-44ab-bf3b-91134bc9bd93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:36.136808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:36.145984 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23f3a7-1e74-44ab-bf3b-91134bc9bd93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:36.148447 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23f3a7-1e74-44ab-bf3b-91134bc9bd93 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-2f23f3a7-1e74-44ab-bf3b-91134bc9bd93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:36.165516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:36.166804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:36.168338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:36.168338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:36.168338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:36.168338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 290/577] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:36.174571 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba4345-8121-4578-9a19-2db5d3016fdc None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:36.178062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23f3a7-1e74-44ab-bf3b-91134bc9bd93 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:36.216301 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac002985-6f17-4d86-a8f3-b2fb0580347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:36.217438 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002985-6f17-4d86-a8f3-b2fb0580347d None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:36.218355 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002985-6f17-4d86-a8f3-b2fb0580347d None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:36.218903 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac002985-6f17-4d86-a8f3-b2fb0580347d None admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:36.220306 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002985-6f17-4d86-a8f3-b2fb0580347d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:36.220830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002985-6f17-4d86-a8f3-b2fb0580347d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:36.223177 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac002985-6f17-4d86-a8f3-b2fb0580347d None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:36.242336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 288/578] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:36.251131 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac002985-6f17-4d86-a8f3-b2fb0580347d None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:36.309771 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23f3a7-1e74-44ab-bf3b-91134bc9bd93 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:36.358858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dbf67-ed2b-4c1b-b863-05e0d4664179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:36.359701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dbf67-ed2b-4c1b-b863-05e0d4664179 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:36.360193 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dbf67-ed2b-4c1b-b863-05e0d4664179 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:36.360598 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dbf67-ed2b-4c1b-b863-05e0d4664179 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:36.361950 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dbf67-ed2b-4c1b-b863-05e0d4664179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:36.362465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dbf67-ed2b-4c1b-b863-05e0d4664179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:36.364502 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dbf67-ed2b-4c1b-b863-05e0d4664179 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:36.382988 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 291/579] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:36.383161 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac002985-6f17-4d86-a8f3-b2fb0580347d None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:36.384105 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:36.384977 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dbf67-ed2b-4c1b-b863-05e0d4664179 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:36.433485 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32913b8-65a8-46bf-88e7-e058faba76a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:36.434160 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32913b8-65a8-46bf-88e7-e058faba76a3 None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:36.434438 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32913b8-65a8-46bf-88e7-e058faba76a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:36.434712 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32913b8-65a8-46bf-88e7-e058faba76a3 None admin] PATH_INFO: `/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/c0d818956e1048a096830ec372382e7e/roles/80dbe26dc5454ef49e2feba96589b473` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:36.448240 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:36.451296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32913b8-65a8-46bf-88e7-e058faba76a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b84e7b6ac1644538bb6ef2874a1f0cf, user_id=c0d818956e1048a096830ec372382e7e, role_id=80dbe26dc5454ef49e2feba96589b473)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:36.452894 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32913b8-65a8-46bf-88e7-e058faba76a3 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:36.504872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dbf67-ed2b-4c1b-b863-05e0d4664179 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:36.540560 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feca72-a996-4cbd-ae6c-c1c32010cf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:36.541215 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feca72-a996-4cbd-ae6c-c1c32010cf60 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:36.541492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feca72-a996-4cbd-ae6c-c1c32010cf60 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:36.541757 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feca72-a996-4cbd-ae6c-c1c32010cf60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:36.548703 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feca72-a996-4cbd-ae6c-c1c32010cf60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:36.550304 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feca72-a996-4cbd-ae6c-c1c32010cf60 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-96feca72-a996-4cbd-ae6c-c1c32010cf60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:36.563199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:36.564171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:36.565083 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:36.565083 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:36.565083 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:36.565083 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:36.565083 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:36.565083 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:36.565083 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:36.565083 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:36.572772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 292/581] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:36.572772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feca72-a996-4cbd-ae6c-c1c32010cf60 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:36.573938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 289/581] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:27:36 2022] PUT /identity/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/c0d818956e1048a096830ec372382e7e/roles/80dbe26dc5454ef49e2feba96589b473 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 17:27:36.692559 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feca72-a996-4cbd-ae6c-c1c32010cf60 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:36.704008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:36.737125 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0accb23-2958-47c1-b02c-595b82273c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:36.738101 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0accb23-2958-47c1-b02c-595b82273c44 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:36.738563 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0accb23-2958-47c1-b02c-595b82273c44 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:36.739077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0accb23-2958-47c1-b02c-595b82273c44 None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:36.740240 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0accb23-2958-47c1-b02c-595b82273c44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:36.740750 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0accb23-2958-47c1-b02c-595b82273c44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:36.742402 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0accb23-2958-47c1-b02c-595b82273c44 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:36.756005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 293/582] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:36.761898 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32913b8-65a8-46bf-88e7-e058faba76a3 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:36.876877 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32913b8-65a8-46bf-88e7-e058faba76a3 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:36.911323 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662e21a-2369-4352-b513-39b6b4f0abae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:36.912215 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662e21a-2369-4352-b513-39b6b4f0abae None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:36.912671 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662e21a-2369-4352-b513-39b6b4f0abae None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:36.913133 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662e21a-2369-4352-b513-39b6b4f0abae None admin] PATH_INFO: `/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/f21c562918c04d18aa0b01a3bdd4d6af/roles/80dbe26dc5454ef49e2feba96589b473` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:36.928865 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662e21a-2369-4352-b513-39b6b4f0abae None admin] RBAC: Authorizing `identity:create_grant(project_id=8b84e7b6ac1644538bb6ef2874a1f0cf, user_id=f21c562918c04d18aa0b01a3bdd4d6af, role_id=80dbe26dc5454ef49e2feba96589b473)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:36.930512 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662e21a-2369-4352-b513-39b6b4f0abae None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:37.015221 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 290/583] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:27:36 2022] PUT /identity/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/f21c562918c04d18aa0b01a3bdd4d6af/roles/80dbe26dc5454ef49e2feba96589b473 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:27:37.782098 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e3635-f1bd-4456-a85d-4c79cc64dbd3 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:37.782595 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e3635-f1bd-4456-a85d-4c79cc64dbd3 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:37.782595 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e3635-f1bd-4456-a85d-4c79cc64dbd3 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:37.784037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 294/584] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:37.789645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5437-b0f1-4aee-b046-1b08a53e684e None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:37.790989 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5437-b0f1-4aee-b046-1b08a53e684e None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:37.791468 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd5437-b0f1-4aee-b046-1b08a53e684e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:37.798475 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:37.811226 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-d9cd5437-b0f1-4aee-b046-1b08a53e684e None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:37.815482 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-d9cd5437-b0f1-4aee-b046-1b08a53e684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:37.880995 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 291/585] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:38.225552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e3635-f1bd-4456-a85d-4c79cc64dbd3 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:38.248227 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2916d-b3c2-4a1b-8853-6c6a7419040c None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:38.248511 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2916d-b3c2-4a1b-8853-6c6a7419040c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:38.248834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2916d-b3c2-4a1b-8853-6c6a7419040c None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:38.250422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 292/586] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:27:38.255280 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b1d3c-c94e-451b-aa64-859abcc63c3c None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:38.255567 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b1d3c-c94e-451b-aa64-859abcc63c3c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:38.255841 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b1d3c-c94e-451b-aa64-859abcc63c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:38.274059 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-e18b1d3c-c94e-451b-aa64-859abcc63c3c None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:38.275270 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-e18b1d3c-c94e-451b-aa64-859abcc63c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:38.355254 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e3635-f1bd-4456-a85d-4c79cc64dbd3 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:38.360851 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 293/587] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:27:38.395066 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ab0e6-81d7-45de-98df-906afa962108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:38.395699 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ab0e6-81d7-45de-98df-906afa962108 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:38.396279 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ab0e6-81d7-45de-98df-906afa962108 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:38.396621 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ab0e6-81d7-45de-98df-906afa962108 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:38.407844 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ab0e6-81d7-45de-98df-906afa962108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-e10ab0e6-81d7-45de-98df-906afa962108 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:38.414037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:38.414973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:38.415834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:38.415834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:38.415834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:38.415834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:38.415834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:38.415834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:38.415834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:38.415834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:38.415834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:38.415834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:38.415834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:38.415834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:38.426939 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 295/588] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:38.432556 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b1d3c-c94e-451b-aa64-859abcc63c3c None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:38.497471 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:38.537178 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b1d3c-c94e-451b-aa64-859abcc63c3c None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:38.573189 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce9ed9-f55c-4470-bbb5-9ca737d60435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:38.574124 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce9ed9-f55c-4470-bbb5-9ca737d60435 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:38.574554 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce9ed9-f55c-4470-bbb5-9ca737d60435 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:38.574974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce9ed9-f55c-4470-bbb5-9ca737d60435 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:38.575774 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce9ed9-f55c-4470-bbb5-9ca737d60435 None admin] RBAC: Adding query filter params (name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:38.576242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce9ed9-f55c-4470-bbb5-9ca737d60435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:38.577772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce9ed9-f55c-4470-bbb5-9ca737d60435 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:38.586439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 294/589] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:27:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:38.592280 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ab0e6-81d7-45de-98df-906afa962108 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:38.622666 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:38.691438 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce9ed9-f55c-4470-bbb5-9ca737d60435 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:38.700824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ab0e6-81d7-45de-98df-906afa962108 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:38.748763 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89340b94-844b-40b3-b3ab-cfb2e73510cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:38.749326 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340b94-844b-40b3-b3ab-cfb2e73510cf None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:38.749607 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340b94-844b-40b3-b3ab-cfb2e73510cf None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:38.749878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340b94-844b-40b3-b3ab-cfb2e73510cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:38.762009 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89340b94-844b-40b3-b3ab-cfb2e73510cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:38.763685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89340b94-844b-40b3-b3ab-cfb2e73510cf None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-89340b94-844b-40b3-b3ab-cfb2e73510cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:38.779872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:38.781176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:38.782889 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:38.782889 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:38.782889 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:38.782889 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 296/590] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:38.787158 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89340b94-844b-40b3-b3ab-cfb2e73510cf None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:38.807325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce9ed9-f55c-4470-bbb5-9ca737d60435 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:38.835660 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:38.848580 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd1299-8e3b-4b54-8b5d-502879f2fb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:38.849372 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd1299-8e3b-4b54-8b5d-502879f2fb0e None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:38.849709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd1299-8e3b-4b54-8b5d-502879f2fb0e None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:38.850039 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd1299-8e3b-4b54-8b5d-502879f2fb0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:38.861986 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd1299-8e3b-4b54-8b5d-502879f2fb0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-d0bd1299-8e3b-4b54-8b5d-502879f2fb0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:38.866778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:38.867972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:38.869899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:38.869899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:38.869899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:38.869899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:38.869899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:38.869899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:38.869899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:38.869899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:38.869899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:38.869899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:38.869899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:38.869899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:38.875933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 295/591] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:38.877231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd1299-8e3b-4b54-8b5d-502879f2fb0e None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:38.892463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:38.918877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89340b94-844b-40b3-b3ab-cfb2e73510cf None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:38.959037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f501a09-b2b2-4d33-b6ee-89fcef5d15e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:38.959978 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501a09-b2b2-4d33-b6ee-89fcef5d15e0 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:38.960404 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501a09-b2b2-4d33-b6ee-89fcef5d15e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:38.960848 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501a09-b2b2-4d33-b6ee-89fcef5d15e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:38.961755 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f501a09-b2b2-4d33-b6ee-89fcef5d15e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:38.962335 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f501a09-b2b2-4d33-b6ee-89fcef5d15e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:38.963939 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f501a09-b2b2-4d33-b6ee-89fcef5d15e0 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:38.983014 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd1299-8e3b-4b54-8b5d-502879f2fb0e None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:38.983209 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 297/592] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:38.984667 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f501a09-b2b2-4d33-b6ee-89fcef5d15e0 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:39.015972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba24fc-e247-4636-a6f6-02796d57aa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:39.016489 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba24fc-e247-4636-a6f6-02796d57aa5a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.016813 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba24fc-e247-4636-a6f6-02796d57aa5a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.017086 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba24fc-e247-4636-a6f6-02796d57aa5a None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.017749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba24fc-e247-4636-a6f6-02796d57aa5a None admin] RBAC: Adding query filter params (name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:39.018049 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba24fc-e247-4636-a6f6-02796d57aa5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:39.019462 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba24fc-e247-4636-a6f6-02796d57aa5a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:39.029170 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 296/593] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:27:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:39.029358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6825-a538-4728-be2b-7df62051bbcb None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.029626 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6825-a538-4728-be2b-7df62051bbcb None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.029877 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6825-a538-4728-be2b-7df62051bbcb None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.031053 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 297/594] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:39.033379 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6825-a538-4728-be2b-7df62051bbcb None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:39.087698 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:39.093684 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f501a09-b2b2-4d33-b6ee-89fcef5d15e0 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:39.131657 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0e0f0-a327-4263-9291-f544ce17bf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:39.132366 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0e0f0-a327-4263-9291-f544ce17bf04 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.132675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0e0f0-a327-4263-9291-f544ce17bf04 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.132950 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0e0f0-a327-4263-9291-f544ce17bf04 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.141085 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0e0f0-a327-4263-9291-f544ce17bf04 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:39.142568 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0e0f0-a327-4263-9291-f544ce17bf04 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:39.146528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:39.149994 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6825-a538-4728-be2b-7df62051bbcb None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-92a0e0f0-a327-4263-9291-f544ce17bf04 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:39.156625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:39.168604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 298/595] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 19 17:27:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92997f4c-9a70-4872-9ab4-2b180bf5b224 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.169610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92997f4c-9a70-4872-9ab4-2b180bf5b224 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.170348 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92997f4c-9a70-4872-9ab4-2b180bf5b224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.182750 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-92997f4c-9a70-4872-9ab4-2b180bf5b224 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:39.183951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-92997f4c-9a70-4872-9ab4-2b180bf5b224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:39.195614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fcdd2-8008-4554-8706-8507b29fdcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:39.196322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fcdd2-8008-4554-8706-8507b29fdcea None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.196706 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fcdd2-8008-4554-8706-8507b29fdcea None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.197082 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fcdd2-8008-4554-8706-8507b29fdcea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.208916 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fcdd2-8008-4554-8706-8507b29fdcea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:39.210347 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fcdd2-8008-4554-8706-8507b29fdcea None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-350fcdd2-8008-4554-8706-8507b29fdcea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:39.224979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:39.226146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:39.227377 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:39.227377 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:39.227377 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:39.231264 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 298/596] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:39.231873 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fcdd2-8008-4554-8706-8507b29fdcea None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:39.268848 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 299/597] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:39.268848 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92997f4c-9a70-4872-9ab4-2b180bf5b224 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:39.344544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:39.349155 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fcdd2-8008-4554-8706-8507b29fdcea None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:39.368902 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92997f4c-9a70-4872-9ab4-2b180bf5b224 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:39.383738 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b2654-c586-4dec-8081-5b3c6b6683e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:39.385050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b2654-c586-4dec-8081-5b3c6b6683e1 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.385392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b2654-c586-4dec-8081-5b3c6b6683e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.385732 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b2654-c586-4dec-8081-5b3c6b6683e1 None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.386522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b2654-c586-4dec-8081-5b3c6b6683e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:39.386894 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b2654-c586-4dec-8081-5b3c6b6683e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:39.388380 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b2654-c586-4dec-8081-5b3c6b6683e1 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:39.398494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:39.404391 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73a0e1-a9cf-4a8b-bbc2-b944908ee211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:39.405099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73a0e1-a9cf-4a8b-bbc2-b944908ee211 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.405450 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73a0e1-a9cf-4a8b-bbc2-b944908ee211 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.410378 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73a0e1-a9cf-4a8b-bbc2-b944908ee211 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.410378 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73a0e1-a9cf-4a8b-bbc2-b944908ee211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:39.410378 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73a0e1-a9cf-4a8b-bbc2-b944908ee211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:39.410378 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73a0e1-a9cf-4a8b-bbc2-b944908ee211 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:39.412538 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 299/598] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 19 17:27:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:39.413723 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b375a29-3623-47ed-80ac-39d991c71a3d None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.414008 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b375a29-3623-47ed-80ac-39d991c71a3d None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.414283 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b375a29-3623-47ed-80ac-39d991c71a3d None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.420534 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 300/599] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:39.420534 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b375a29-3623-47ed-80ac-39d991c71a3d None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:39.429470 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 300/600] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:39.430671 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93b080-7f1e-4d4f-98f2-7f3c58738752 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.430970 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93b080-7f1e-4d4f-98f2-7f3c58738752 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.431301 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93b080-7f1e-4d4f-98f2-7f3c58738752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.448857 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-fd93b080-7f1e-4d4f-98f2-7f3c58738752 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:39.450032 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-fd93b080-7f1e-4d4f-98f2-7f3c58738752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:39.520846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 301/601] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:39.520846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93b080-7f1e-4d4f-98f2-7f3c58738752 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:39.532210 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b375a29-3623-47ed-80ac-39d991c71a3d None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:39.570175 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedeecb-8a29-47e6-b066-3475ebacb76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:39.571006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedeecb-8a29-47e6-b066-3475ebacb76a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.571563 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedeecb-8a29-47e6-b066-3475ebacb76a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.572401 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedeecb-8a29-47e6-b066-3475ebacb76a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.599119 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:39.630945 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93b080-7f1e-4d4f-98f2-7f3c58738752 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:39.643872 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedeecb-8a29-47e6-b066-3475ebacb76a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:39.645362 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedeecb-8a29-47e6-b066-3475ebacb76a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:39.652942 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:39.669499 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75e778-f468-4ad5-ae6a-cbdbf28ce7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:39.670122 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75e778-f468-4ad5-ae6a-cbdbf28ce7a5 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.670427 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75e778-f468-4ad5-ae6a-cbdbf28ce7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.670671 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75e778-f468-4ad5-ae6a-cbdbf28ce7a5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.678623 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75e778-f468-4ad5-ae6a-cbdbf28ce7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:39.680074 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75e778-f468-4ad5-ae6a-cbdbf28ce7a5 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-9e75e778-f468-4ad5-ae6a-cbdbf28ce7a5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:39.693817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:39.694749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:39.695690 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:39.695690 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:39.695690 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:39.695690 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:39.695690 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:39.695690 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:39.695690 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:39.695690 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:39.695690 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 17:27:39.695690 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:39.699917 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 302/602] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:39.700889 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75e778-f468-4ad5-ae6a-cbdbf28ce7a5 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:39.747050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 301/603] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:39.748254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedeecb-8a29-47e6-b066-3475ebacb76a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:39.807391 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:39.812955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75e778-f468-4ad5-ae6a-cbdbf28ce7a5 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:39.850222 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedeecb-8a29-47e6-b066-3475ebacb76a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:39.856123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c236fdd-b3b0-43a1-a944-e7c7ac14ce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:39.856787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236fdd-b3b0-43a1-a944-e7c7ac14ce97 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.857077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236fdd-b3b0-43a1-a944-e7c7ac14ce97 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.857350 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c236fdd-b3b0-43a1-a944-e7c7ac14ce97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.867524 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c236fdd-b3b0-43a1-a944-e7c7ac14ce97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-0c236fdd-b3b0-43a1-a944-e7c7ac14ce97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:39.873214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:39.879118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 303/604] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:39.880197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c236fdd-b3b0-43a1-a944-e7c7ac14ce97 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:39.885848 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0bcd-06f5-452a-a67e-3e1439390d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:39.886446 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0bcd-06f5-452a-a67e-3e1439390d16 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:39.886727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0bcd-06f5-452a-a67e-3e1439390d16 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:39.886999 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0bcd-06f5-452a-a67e-3e1439390d16 None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:39.887723 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0bcd-06f5-452a-a67e-3e1439390d16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:39.888024 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0bcd-06f5-452a-a67e-3e1439390d16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:39.889472 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0bcd-06f5-452a-a67e-3e1439390d16 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:39.906053 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 302/605] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 19 17:27:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:39.906898 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0bcd-06f5-452a-a67e-3e1439390d16 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:39.920568 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:39.977379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c236fdd-b3b0-43a1-a944-e7c7ac14ce97 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.003852 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0bcd-06f5-452a-a67e-3e1439390d16 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.010695 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5403c-c63c-48de-abee-bbc48c67a5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:40.011307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5403c-c63c-48de-abee-bbc48c67a5d6 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:40.011582 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5403c-c63c-48de-abee-bbc48c67a5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:40.011850 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5403c-c63c-48de-abee-bbc48c67a5d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:40.017382 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:40.022240 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5403c-c63c-48de-abee-bbc48c67a5d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:40.023678 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5403c-c63c-48de-abee-bbc48c67a5d6 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:40.036361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a6787-c327-48f2-8102-9c9e97903984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:40.037078 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6787-c327-48f2-8102-9c9e97903984 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:40.037353 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6787-c327-48f2-8102-9c9e97903984 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-d3a5403c-c63c-48de-abee-bbc48c67a5d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:40.037543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:40.038614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:40.039493 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:40.039493 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:40.039493 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:40.039673 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6787-c327-48f2-8102-9c9e97903984 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:40.039743 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 304/606] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:40.039811 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5403c-c63c-48de-abee-bbc48c67a5d6 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:40.059250 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a6787-c327-48f2-8102-9c9e97903984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-6a3a6787-c327-48f2-8102-9c9e97903984 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:40.063797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:40.064956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 303/607] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:40.067483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a6787-c327-48f2-8102-9c9e97903984 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:40.136675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:40.145090 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5403c-c63c-48de-abee-bbc48c67a5d6 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.168428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a6787-c327-48f2-8102-9c9e97903984 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.178414 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caacc68-58ba-4875-a7b7-f50b92bd2f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:40.179001 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caacc68-58ba-4875-a7b7-f50b92bd2f37 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:40.179273 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caacc68-58ba-4875-a7b7-f50b92bd2f37 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:40.179537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caacc68-58ba-4875-a7b7-f50b92bd2f37 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:40.180175 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caacc68-58ba-4875-a7b7-f50b92bd2f37 None admin] RBAC: Adding query filter params (name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:40.180469 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caacc68-58ba-4875-a7b7-f50b92bd2f37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:40.181887 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caacc68-58ba-4875-a7b7-f50b92bd2f37 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:40.189833 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 305/608] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:27:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:40.190402 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caacc68-58ba-4875-a7b7-f50b92bd2f37 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:40.213155 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca063c-0d34-40ba-bd0a-be4cfab9d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:40.214166 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca063c-0d34-40ba-bd0a-be4cfab9d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:40.214728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca063c-0d34-40ba-bd0a-be4cfab9d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:40.215208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca063c-0d34-40ba-bd0a-be4cfab9d0c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:40.258453 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:40.283158 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca063c-0d34-40ba-bd0a-be4cfab9d0c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:40.284708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca063c-0d34-40ba-bd0a-be4cfab9d0c4 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:40.299601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caacc68-58ba-4875-a7b7-f50b92bd2f37 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.334659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ce8a-d3cc-438e-910e-e2f7c42dab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:40.335178 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ce8a-d3cc-438e-910e-e2f7c42dab9d None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:40.335451 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ce8a-d3cc-438e-910e-e2f7c42dab9d None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:40.335713 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ce8a-d3cc-438e-910e-e2f7c42dab9d None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:40.336336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602ce8a-d3cc-438e-910e-e2f7c42dab9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:40.336627 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602ce8a-d3cc-438e-910e-e2f7c42dab9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:40.338557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602ce8a-d3cc-438e-910e-e2f7c42dab9d None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:40.349866 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 306/609] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:40.350624 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ce8a-d3cc-438e-910e-e2f7c42dab9d None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:40.365088 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:40.394729 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 304/610] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:40.395548 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca063c-0d34-40ba-bd0a-be4cfab9d0c4 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:40.455007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ce8a-d3cc-438e-910e-e2f7c42dab9d None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.470291 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:40.488196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0870d16-3003-490b-aa0b-ddcd4abd3a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:40.488810 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0870d16-3003-490b-aa0b-ddcd4abd3a75 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:40.489085 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0870d16-3003-490b-aa0b-ddcd4abd3a75 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:40.489350 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0870d16-3003-490b-aa0b-ddcd4abd3a75 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:40.489996 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0870d16-3003-490b-aa0b-ddcd4abd3a75 None admin] RBAC: Adding query filter params (name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:40.490293 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0870d16-3003-490b-aa0b-ddcd4abd3a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:40.491768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0870d16-3003-490b-aa0b-ddcd4abd3a75 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:40.495039 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca063c-0d34-40ba-bd0a-be4cfab9d0c4 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.499920 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 307/611] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:27:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:40.500705 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0870d16-3003-490b-aa0b-ddcd4abd3a75 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:40.528826 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8a705-7bf5-4779-b0c0-e71474b6c513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:40.529444 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8a705-7bf5-4779-b0c0-e71474b6c513 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:40.529714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8a705-7bf5-4779-b0c0-e71474b6c513 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:40.529985 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8a705-7bf5-4779-b0c0-e71474b6c513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:40.539512 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8a705-7bf5-4779-b0c0-e71474b6c513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:40.541559 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8a705-7bf5-4779-b0c0-e71474b6c513 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-d4d8a705-7bf5-4779-b0c0-e71474b6c513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:40.555564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:40.556544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:40.558120 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:40.558120 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:40.558120 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:40.558120 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 305/612] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:40.558120 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8a705-7bf5-4779-b0c0-e71474b6c513 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:40.581342 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:40.603694 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0870d16-3003-490b-aa0b-ddcd4abd3a75 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.637137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2bca0-c1a7-4818-8536-77461fe66874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:40.637741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2bca0-c1a7-4818-8536-77461fe66874 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:40.638015 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2bca0-c1a7-4818-8536-77461fe66874 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:40.638282 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2bca0-c1a7-4818-8536-77461fe66874 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:40.644812 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2bca0-c1a7-4818-8536-77461fe66874 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:40.646236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2bca0-c1a7-4818-8536-77461fe66874 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-76b2bca0-c1a7-4818-8536-77461fe66874 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:40.657458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:40.658489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:40.659369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:40.659369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:40.659369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:40.659369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:40.659369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:40.659369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:40.659369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:40.659369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:40.660016 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8a705-7bf5-4779-b0c0-e71474b6c513 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.660094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 308/613] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:40.660094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2bca0-c1a7-4818-8536-77461fe66874 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:40.684029 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:40.692354 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451e4f-35c6-4189-bff2-ce5ba2db6ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:40.693010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451e4f-35c6-4189-bff2-ce5ba2db6ed9 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:40.693342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451e4f-35c6-4189-bff2-ce5ba2db6ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:40.693620 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451e4f-35c6-4189-bff2-ce5ba2db6ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:40.704289 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1451e4f-35c6-4189-bff2-ce5ba2db6ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:40.705776 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1451e4f-35c6-4189-bff2-ce5ba2db6ed9 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-a1451e4f-35c6-4189-bff2-ce5ba2db6ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:40.719394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:40.720545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:40.721693 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:40.721693 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:40.721693 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:40.725090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 306/614] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:40.725886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451e4f-35c6-4189-bff2-ce5ba2db6ed9 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:40.763706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2bca0-c1a7-4818-8536-77461fe66874 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.796175 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09954106-fcc1-46ac-a4dc-7259eeec9cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:40.797077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09954106-fcc1-46ac-a4dc-7259eeec9cbb None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:40.797349 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09954106-fcc1-46ac-a4dc-7259eeec9cbb None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:40.797613 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09954106-fcc1-46ac-a4dc-7259eeec9cbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:40.800155 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:40.808948 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09954106-fcc1-46ac-a4dc-7259eeec9cbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:40.810475 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09954106-fcc1-46ac-a4dc-7259eeec9cbb None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-09954106-fcc1-46ac-a4dc-7259eeec9cbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:40.823979 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:40.832084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:40.833168 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:40.833168 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:40.833168 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:40.833168 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 309/615] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:40.833454 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451e4f-35c6-4189-bff2-ce5ba2db6ed9 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.833862 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09954106-fcc1-46ac-a4dc-7259eeec9cbb None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:40.859125 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308c30f-f05f-47a2-a2cf-0a0dadf360e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:40.859659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308c30f-f05f-47a2-a2cf-0a0dadf360e0 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:40.859940 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308c30f-f05f-47a2-a2cf-0a0dadf360e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:40.860209 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308c30f-f05f-47a2-a2cf-0a0dadf360e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:40.860865 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308c30f-f05f-47a2-a2cf-0a0dadf360e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:40.861165 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308c30f-f05f-47a2-a2cf-0a0dadf360e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:40.862520 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308c30f-f05f-47a2-a2cf-0a0dadf360e0 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:40.874390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 307/616] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:40.875029 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308c30f-f05f-47a2-a2cf-0a0dadf360e0 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:40.913416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:40.933386 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09954106-fcc1-46ac-a4dc-7259eeec9cbb None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.966121 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d7c97-27fc-4835-9590-f2659592f17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:40.966712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d7c97-27fc-4835-9590-f2659592f17d None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:40.966990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d7c97-27fc-4835-9590-f2659592f17d None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:40.967261 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d7c97-27fc-4835-9590-f2659592f17d None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:40.967933 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d7c97-27fc-4835-9590-f2659592f17d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:40.968234 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d7c97-27fc-4835-9590-f2659592f17d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:40.969699 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d7c97-27fc-4835-9590-f2659592f17d None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:40.971597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308c30f-f05f-47a2-a2cf-0a0dadf360e0 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:40.981220 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 310/617] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:40.981994 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d7c97-27fc-4835-9590-f2659592f17d None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:41.007036 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8a200-4adb-41dc-ad54-b4336ca17621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:41.007628 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a200-4adb-41dc-ad54-b4336ca17621 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:41.007900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a200-4adb-41dc-ad54-b4336ca17621 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:41.008168 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a200-4adb-41dc-ad54-b4336ca17621 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:41.008824 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8a200-4adb-41dc-ad54-b4336ca17621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:41.009185 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8a200-4adb-41dc-ad54-b4336ca17621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:41.010531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8a200-4adb-41dc-ad54-b4336ca17621 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:41.021245 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 308/618] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:41.022010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8a200-4adb-41dc-ad54-b4336ca17621 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:41.029177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:41.078842 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d7c97-27fc-4835-9590-f2659592f17d None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:41.113420 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa06423-0637-4577-914f-ebb691680e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:41.113939 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa06423-0637-4577-914f-ebb691680e67 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:41.114207 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa06423-0637-4577-914f-ebb691680e67 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:41.114473 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa06423-0637-4577-914f-ebb691680e67 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:41.115090 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa06423-0637-4577-914f-ebb691680e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:41.115382 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa06423-0637-4577-914f-ebb691680e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:41.116594 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:41.116800 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa06423-0637-4577-914f-ebb691680e67 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:41.120979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8a200-4adb-41dc-ad54-b4336ca17621 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:41.128436 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 311/619] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:41.129365 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa06423-0637-4577-914f-ebb691680e67 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:41.154627 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ead7f-cd0c-4325-8176-69006623ab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:41.155334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ead7f-cd0c-4325-8176-69006623ab76 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:41.155675 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ead7f-cd0c-4325-8176-69006623ab76 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:41.156009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ead7f-cd0c-4325-8176-69006623ab76 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:41.163688 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ead7f-cd0c-4325-8176-69006623ab76 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:41.165146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ead7f-cd0c-4325-8176-69006623ab76 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-ab5ead7f-cd0c-4325-8176-69006623ab76 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:41.176116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:41.177277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:41.178645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:41.178645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:41.178645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:41.178645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:41.178645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:41.178645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:41.178645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:41.178645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:41.178645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:27:41.178645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:41.178645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 309/620] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:41.178645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ead7f-cd0c-4325-8176-69006623ab76 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:41.228642 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa06423-0637-4577-914f-ebb691680e67 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:41.237110 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:41.262621 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229af38-0c8f-4e4c-a761-9074c9d39744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:41.263204 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229af38-0c8f-4e4c-a761-9074c9d39744 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:41.263531 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229af38-0c8f-4e4c-a761-9074c9d39744 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:41.263852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229af38-0c8f-4e4c-a761-9074c9d39744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:41.264631 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229af38-0c8f-4e4c-a761-9074c9d39744 None admin] RBAC: Adding query filter params (role.id=80dbe26dc5454ef49e2feba96589b473, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=fb1c954936f64051b09afba8df544ec7) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:41.265217 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229af38-0c8f-4e4c-a761-9074c9d39744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:41.267073 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229af38-0c8f-4e4c-a761-9074c9d39744 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:41.273671 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 312/621] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:27:41 2022] GET /identity/v3/role_assignments?user.id=fb1c954936f64051b09afba8df544ec7&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=80dbe26dc5454ef49e2feba96589b473 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:41.274489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229af38-0c8f-4e4c-a761-9074c9d39744 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:41.277827 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ead7f-cd0c-4325-8176-69006623ab76 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:41.320082 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a2a91-239e-4778-906a-6f1c5e80159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:41.320871 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a2a91-239e-4778-906a-6f1c5e80159b None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:41.321260 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a2a91-239e-4778-906a-6f1c5e80159b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:41.321545 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a2a91-239e-4778-906a-6f1c5e80159b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:41.329879 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a2a91-239e-4778-906a-6f1c5e80159b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:41.331425 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a2a91-239e-4778-906a-6f1c5e80159b None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-6f2a2a91-239e-4778-906a-6f1c5e80159b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:41.344315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:41.345526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:41.346655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:41.346655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:41.346655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:41.346655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:41.346655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:41.346655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:41.346655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:41.346655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:41.352025 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 310/622] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:41.353733 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a2a91-239e-4778-906a-6f1c5e80159b None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:41.386829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:41.403432 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229af38-0c8f-4e4c-a761-9074c9d39744 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:41.446207 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e73e-9817-4c62-941f-de3c9468afd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:41.446870 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e73e-9817-4c62-941f-de3c9468afd1 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:41.447520 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e73e-9817-4c62-941f-de3c9468afd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:41.447520 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02e73e-9817-4c62-941f-de3c9468afd1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:41.455683 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02e73e-9817-4c62-941f-de3c9468afd1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:41.457167 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02e73e-9817-4c62-941f-de3c9468afd1 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-2e02e73e-9817-4c62-941f-de3c9468afd1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:41.468818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:41.469813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:41.471040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:41.471040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:41.471040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:41.471040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:41.471040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:41.471040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:41.471040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:41.471040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:41.471040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 17:27:41.471040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:41.471040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 313/623] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:27:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:41.471640 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e73e-9817-4c62-941f-de3c9468afd1 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:41.483099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a2a91-239e-4778-906a-6f1c5e80159b None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:41.512986 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:41.523602 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d6aa-20fe-4e39-bc59-e4a764910c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:41.524442 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d6aa-20fe-4e39-bc59-e4a764910c39 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:41.524799 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d6aa-20fe-4e39-bc59-e4a764910c39 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:41.525039 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575d6aa-20fe-4e39-bc59-e4a764910c39 None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:41.526455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575d6aa-20fe-4e39-bc59-e4a764910c39 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:41.526455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575d6aa-20fe-4e39-bc59-e4a764910c39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:41.527466 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575d6aa-20fe-4e39-bc59-e4a764910c39 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:41.550597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 311/624] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 19 17:27:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:41.551509 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d6aa-20fe-4e39-bc59-e4a764910c39 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:41.596212 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02e73e-9817-4c62-941f-de3c9468afd1 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:41.632519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00184c03-d244-41bc-b2cd-d11c52a2be4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:41.633154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00184c03-d244-41bc-b2cd-d11c52a2be4b None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:41.633433 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00184c03-d244-41bc-b2cd-d11c52a2be4b None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:41.633705 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00184c03-d244-41bc-b2cd-d11c52a2be4b None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:41.634278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:41.634395 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00184c03-d244-41bc-b2cd-d11c52a2be4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:41.634701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00184c03-d244-41bc-b2cd-d11c52a2be4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:41.636185 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00184c03-d244-41bc-b2cd-d11c52a2be4b None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:41.653346 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 314/625] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:41.653346 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00184c03-d244-41bc-b2cd-d11c52a2be4b None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:41.663868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575d6aa-20fe-4e39-bc59-e4a764910c39 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:41.706319 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670df30a-0276-410f-a556-e021d60c88ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:41.706922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670df30a-0276-410f-a556-e021d60c88ac None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:41.707200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670df30a-0276-410f-a556-e021d60c88ac None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:41.707469 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670df30a-0276-410f-a556-e021d60c88ac None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:41.708186 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670df30a-0276-410f-a556-e021d60c88ac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:41.708491 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670df30a-0276-410f-a556-e021d60c88ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:41.710134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670df30a-0276-410f-a556-e021d60c88ac None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:41.733141 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 312/626] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Aug 19 17:27:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:41.733141 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670df30a-0276-410f-a556-e021d60c88ac None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:41.751915 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:41.760708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00184c03-d244-41bc-b2cd-d11c52a2be4b None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:41.798032 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ea0dc-8283-4065-8142-f7fa531e10ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:41.798987 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ea0dc-8283-4065-8142-f7fa531e10ad None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:41.799470 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ea0dc-8283-4065-8142-f7fa531e10ad None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:41.799942 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ea0dc-8283-4065-8142-f7fa531e10ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:41.838920 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670df30a-0276-410f-a556-e021d60c88ac None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:41.870216 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ea0dc-8283-4065-8142-f7fa531e10ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:41.871677 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ea0dc-8283-4065-8142-f7fa531e10ad None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:41.875583 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076fa32-6621-4dc0-8c60-843e58fe59c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:41.876187 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076fa32-6621-4dc0-8c60-843e58fe59c0 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:41.876467 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076fa32-6621-4dc0-8c60-843e58fe59c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:41.876756 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076fa32-6621-4dc0-8c60-843e58fe59c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:41.877470 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076fa32-6621-4dc0-8c60-843e58fe59c0 None admin] RBAC: Adding query filter params (role.id=80dbe26dc5454ef49e2feba96589b473, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=fbe5b4476e8e413f8d409c8e73c4c4f4) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:41.877773 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076fa32-6621-4dc0-8c60-843e58fe59c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:41.879203 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076fa32-6621-4dc0-8c60-843e58fe59c0 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:41.881464 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:41.896753 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 313/627] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:27:41 2022] GET /identity/v3/role_assignments?user.id=fbe5b4476e8e413f8d409c8e73c4c4f4&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=80dbe26dc5454ef49e2feba96589b473 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:41.896753 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076fa32-6621-4dc0-8c60-843e58fe59c0 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:41.991823 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:42.003151 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076fa32-6621-4dc0-8c60-843e58fe59c0 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:42.012471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 315/628] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:42.013802 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ea0dc-8283-4065-8142-f7fa531e10ad None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:42.046774 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991fecb-90a4-410d-885c-0f319bc1ef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:42.047896 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991fecb-90a4-410d-885c-0f319bc1ef80 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:42.048380 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991fecb-90a4-410d-885c-0f319bc1ef80 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:42.048894 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991fecb-90a4-410d-885c-0f319bc1ef80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:42.130070 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:42.135846 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991fecb-90a4-410d-885c-0f319bc1ef80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:42.137572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991fecb-90a4-410d-885c-0f319bc1ef80 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:42.154847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ea0dc-8283-4065-8142-f7fa531e10ad None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:42.198676 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb3e81-a3ed-4208-b9f6-54e0006e7771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:42.199304 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb3e81-a3ed-4208-b9f6-54e0006e7771 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:42.199582 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb3e81-a3ed-4208-b9f6-54e0006e7771 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:42.199851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb3e81-a3ed-4208-b9f6-54e0006e7771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:42.210386 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb3e81-a3ed-4208-b9f6-54e0006e7771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:42.211915 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb3e81-a3ed-4208-b9f6-54e0006e7771 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-41bb3e81-a3ed-4208-b9f6-54e0006e7771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:42.237292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:42.238300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:42.239250 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:42.239250 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:42.239250 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:42.239250 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 316/629] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:42.249756 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb3e81-a3ed-4208-b9f6-54e0006e7771 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:42.265083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 314/630] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:42.270460 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991fecb-90a4-410d-885c-0f319bc1ef80 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:42.297969 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:42.354846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb3e81-a3ed-4208-b9f6-54e0006e7771 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:42.376707 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:42.389553 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991fecb-90a4-410d-885c-0f319bc1ef80 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:42.392398 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1522db-61d6-46c4-bd66-db87ce297608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:42.393447 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1522db-61d6-46c4-bd66-db87ce297608 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:42.393447 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1522db-61d6-46c4-bd66-db87ce297608 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:42.396516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1522db-61d6-46c4-bd66-db87ce297608 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:42.396516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1522db-61d6-46c4-bd66-db87ce297608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:42.396516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1522db-61d6-46c4-bd66-db87ce297608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:42.396516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1522db-61d6-46c4-bd66-db87ce297608 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:42.412771 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 317/631] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:42.417343 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1522db-61d6-46c4-bd66-db87ce297608 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:42.448319 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ccb4c-3187-4163-900d-c96060b627e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:42.449633 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ccb4c-3187-4163-900d-c96060b627e0 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:42.450354 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ccb4c-3187-4163-900d-c96060b627e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:42.450830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ccb4c-3187-4163-900d-c96060b627e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:42.466978 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ccb4c-3187-4163-900d-c96060b627e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:42.469676 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ccb4c-3187-4163-900d-c96060b627e0 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-698ccb4c-3187-4163-900d-c96060b627e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:42.489570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:42.490572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:42.491450 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:42.491450 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:42.491450 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:42.491450 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 315/632] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:42.496209 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ccb4c-3187-4163-900d-c96060b627e0 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:42.551528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1522db-61d6-46c4-bd66-db87ce297608 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:42.553986 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:42.588984 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f019c5-1e2e-4021-8fd5-d6560c129dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:42.589608 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f019c5-1e2e-4021-8fd5-d6560c129dee None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:42.589885 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f019c5-1e2e-4021-8fd5-d6560c129dee None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:42.590153 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f019c5-1e2e-4021-8fd5-d6560c129dee None admin] PATH_INFO: `/v3/projects/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:42.597053 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f019c5-1e2e-4021-8fd5-d6560c129dee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:42.598510 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f019c5-1e2e-4021-8fd5-d6560c129dee None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-e7f019c5-1e2e-4021-8fd5-d6560c129dee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:42.610399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:42.611297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:42.612154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:42.612154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:42.612154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:42.612154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:42.612154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:42.612154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:42.612154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:42.612154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:42.616447 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 318/633] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:42.617324 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f019c5-1e2e-4021-8fd5-d6560c129dee None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:42.619197 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ccb4c-3187-4163-900d-c96060b627e0 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:42.660096 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57675d52-b9ff-4b5b-9cee-2754ca3d67c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:42.660703 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57675d52-b9ff-4b5b-9cee-2754ca3d67c0 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:42.661020 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57675d52-b9ff-4b5b-9cee-2754ca3d67c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:42.661289 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57675d52-b9ff-4b5b-9cee-2754ca3d67c0 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:42.661927 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57675d52-b9ff-4b5b-9cee-2754ca3d67c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:42.662597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57675d52-b9ff-4b5b-9cee-2754ca3d67c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:42.663850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57675d52-b9ff-4b5b-9cee-2754ca3d67c0 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:42.677762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 316/634] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:42.682794 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57675d52-b9ff-4b5b-9cee-2754ca3d67c0 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:42.700388 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:42.739189 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f019c5-1e2e-4021-8fd5-d6560c129dee None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:42.789716 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563be63-577a-4092-8e54-116017624ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:42.790365 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563be63-577a-4092-8e54-116017624ad9 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:42.791160 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563be63-577a-4092-8e54-116017624ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:42.791437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563be63-577a-4092-8e54-116017624ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:42.792124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563be63-577a-4092-8e54-116017624ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:42.792429 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563be63-577a-4092-8e54-116017624ad9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:42.793915 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563be63-577a-4092-8e54-116017624ad9 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:42.809746 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57675d52-b9ff-4b5b-9cee-2754ca3d67c0 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:42.817416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 319/635] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:42.818619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563be63-577a-4092-8e54-116017624ad9 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:42.852987 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:42.854891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51920ec5-143f-4053-b7d9-42e7a1cfcfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:42.855560 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51920ec5-143f-4053-b7d9-42e7a1cfcfe3 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:42.855993 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51920ec5-143f-4053-b7d9-42e7a1cfcfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:42.856269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51920ec5-143f-4053-b7d9-42e7a1cfcfe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:42.865042 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51920ec5-143f-4053-b7d9-42e7a1cfcfe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:42.867407 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51920ec5-143f-4053-b7d9-42e7a1cfcfe3 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-51920ec5-143f-4053-b7d9-42e7a1cfcfe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:42.881034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:42.881972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:42.888440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:42.888440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:42.888440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:42.888440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:42.888440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:42.888440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:42.888440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:42.888440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:42.888440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 317/636] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:42.889893 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51920ec5-143f-4053-b7d9-42e7a1cfcfe3 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:42.945988 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563be63-577a-4092-8e54-116017624ad9 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:42.985871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed2b14-c714-4252-86c0-a3f338d78cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:42.986741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed2b14-c714-4252-86c0-a3f338d78cdf None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:42.986741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed2b14-c714-4252-86c0-a3f338d78cdf None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:42.987033 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed2b14-c714-4252-86c0-a3f338d78cdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:42.987703 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed2b14-c714-4252-86c0-a3f338d78cdf None admin] RBAC: Adding query filter params (role.id=80dbe26dc5454ef49e2feba96589b473, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=c0d818956e1048a096830ec372382e7e) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:42.988008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed2b14-c714-4252-86c0-a3f338d78cdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:42.989612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed2b14-c714-4252-86c0-a3f338d78cdf None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:42.990667 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:43.009825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 320/637] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:27:42 2022] GET /identity/v3/role_assignments?user.id=c0d818956e1048a096830ec372382e7e&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=80dbe26dc5454ef49e2feba96589b473 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:43.035362 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51920ec5-143f-4053-b7d9-42e7a1cfcfe3 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:43.073886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876aeb0-184a-45be-a704-34f9170f3cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:43.074429 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876aeb0-184a-45be-a704-34f9170f3cc5 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:43.074707 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876aeb0-184a-45be-a704-34f9170f3cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:43.074977 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876aeb0-184a-45be-a704-34f9170f3cc5 None admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:43.075679 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876aeb0-184a-45be-a704-34f9170f3cc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:43.075981 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876aeb0-184a-45be-a704-34f9170f3cc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:43.077528 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876aeb0-184a-45be-a704-34f9170f3cc5 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:43.094553 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 318/638] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:43.100647 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed2b14-c714-4252-86c0-a3f338d78cdf None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:43.207129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:43.220476 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed2b14-c714-4252-86c0-a3f338d78cdf None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:43.257759 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfea3a-4068-4a4d-a95a-218113e8010f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:43.258355 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfea3a-4068-4a4d-a95a-218113e8010f None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:43.258631 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfea3a-4068-4a4d-a95a-218113e8010f None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:43.258899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfea3a-4068-4a4d-a95a-218113e8010f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:43.260173 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfea3a-4068-4a4d-a95a-218113e8010f None admin] RBAC: Adding query filter params (role.id=80dbe26dc5454ef49e2feba96589b473, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=f21c562918c04d18aa0b01a3bdd4d6af) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:43.260478 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfea3a-4068-4a4d-a95a-218113e8010f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:43.261931 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfea3a-4068-4a4d-a95a-218113e8010f None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:43.268334 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 321/639] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:27:43 2022] GET /identity/v3/role_assignments?user.id=f21c562918c04d18aa0b01a3bdd4d6af&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=80dbe26dc5454ef49e2feba96589b473 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:43.603606 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74602b-1dd2-40f1-ab23-dca73fce6444 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:43.603975 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74602b-1dd2-40f1-ab23-dca73fce6444 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:43.604173 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74602b-1dd2-40f1-ab23-dca73fce6444 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:43.605810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 319/640] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:43.611255 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc8ae8-4393-495c-becd-11351816600f None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:43.611542 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc8ae8-4393-495c-becd-11351816600f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:43.611775 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc8ae8-4393-495c-becd-11351816600f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:43.630653 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-fcfc8ae8-4393-495c-becd-11351816600f None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:43.631840 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-fcfc8ae8-4393-495c-becd-11351816600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:43.706739 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 322/641] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:44.041256 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74602b-1dd2-40f1-ab23-dca73fce6444 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:44.159645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74602b-1dd2-40f1-ab23-dca73fce6444 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:44.198188 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:44.204017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3450e-44b5-46fc-bd99-b33c4d7b26ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:44.204656 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3450e-44b5-46fc-bd99-b33c4d7b26ec None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:44.204963 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3450e-44b5-46fc-bd99-b33c4d7b26ec None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:44.205232 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3450e-44b5-46fc-bd99-b33c4d7b26ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:44.216485 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3450e-44b5-46fc-bd99-b33c4d7b26ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-c6f3450e-44b5-46fc-bd99-b33c4d7b26ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:44.222499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:44.223537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:44.223537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:44.223537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:44.223537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:44.223537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:44.223537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:44.223537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:44.223537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:44.223537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:44.223537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:44.223537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:27:44.223537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:44.224214 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 320/642] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:27:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:44.233078 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc8ae8-4393-495c-becd-11351816600f None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:44.335473 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:44.348663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7ac48-9c3e-42d1-8188-40fed55ea372 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:44.349021 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7ac48-9c3e-42d1-8188-40fed55ea372 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:44.349261 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7ac48-9c3e-42d1-8188-40fed55ea372 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:44.351094 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 321/643] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:44.357130 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8e65f-d10f-45fb-bc36-7fbf4a147228 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:44.357412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8e65f-d10f-45fb-bc36-7fbf4a147228 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:44.357686 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8e65f-d10f-45fb-bc36-7fbf4a147228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:44.358209 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc8ae8-4393-495c-becd-11351816600f None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:44.381192 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-17c8e65f-d10f-45fb-bc36-7fbf4a147228 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:44.382627 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-17c8e65f-d10f-45fb-bc36-7fbf4a147228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:44.398177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8182e-451c-4a26-a51a-363398286720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:44.399581 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8182e-451c-4a26-a51a-363398286720 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:44.400360 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8182e-451c-4a26-a51a-363398286720 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:44.400900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8182e-451c-4a26-a51a-363398286720 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:44.402113 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8182e-451c-4a26-a51a-363398286720 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:44.402594 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8182e-451c-4a26-a51a-363398286720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:44.404929 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8182e-451c-4a26-a51a-363398286720 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:44.417885 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 323/644] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:44.425825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8182e-451c-4a26-a51a-363398286720 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:44.469016 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 322/645] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:27:44.543933 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8182e-451c-4a26-a51a-363398286720 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:44.581249 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96fbeb-cfe3-4550-aa4d-a558dd7cc3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:44.582201 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96fbeb-cfe3-4550-aa4d-a558dd7cc3ff None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:44.582653 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96fbeb-cfe3-4550-aa4d-a558dd7cc3ff None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:44.583096 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96fbeb-cfe3-4550-aa4d-a558dd7cc3ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:44.594387 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96fbeb-cfe3-4550-aa4d-a558dd7cc3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:44.596053 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96fbeb-cfe3-4550-aa4d-a558dd7cc3ff None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:44.598755 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-8d96fbeb-cfe3-4550-aa4d-a558dd7cc3ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:44.612519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:44.613532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:44.614432 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:44.614432 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:44.614432 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:44.616203 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 324/646] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:44.622310 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8e65f-d10f-45fb-bc36-7fbf4a147228 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:44.737543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8e65f-d10f-45fb-bc36-7fbf4a147228 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:44.760831 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:44.776299 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809791-f041-4d6d-9f45-0f1aba29a318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:44.777182 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809791-f041-4d6d-9f45-0f1aba29a318 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:44.777600 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809791-f041-4d6d-9f45-0f1aba29a318 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:44.778133 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809791-f041-4d6d-9f45-0f1aba29a318 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:44.778932 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809791-f041-4d6d-9f45-0f1aba29a318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:44.779371 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809791-f041-4d6d-9f45-0f1aba29a318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:44.780928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809791-f041-4d6d-9f45-0f1aba29a318 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:44.793491 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 323/647] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:44.802084 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96fbeb-cfe3-4550-aa4d-a558dd7cc3ff None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:44.806058 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809791-f041-4d6d-9f45-0f1aba29a318 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:44.926192 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96fbeb-cfe3-4550-aa4d-a558dd7cc3ff None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:44.940176 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809791-f041-4d6d-9f45-0f1aba29a318 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:44.970193 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a11db-0eca-4a6f-a2d4-942102d4f657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:44.971000 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a11db-0eca-4a6f-a2d4-942102d4f657 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:44.971276 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a11db-0eca-4a6f-a2d4-942102d4f657 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:44.971594 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a11db-0eca-4a6f-a2d4-942102d4f657 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:44.981848 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a11db-0eca-4a6f-a2d4-942102d4f657 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:44.983808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a11db-0eca-4a6f-a2d4-942102d4f657 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:44.987934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67404751-275b-4e58-830c-b20044a20985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:44.988868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67404751-275b-4e58-830c-b20044a20985 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:44.989356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67404751-275b-4e58-830c-b20044a20985 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:44.989832 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67404751-275b-4e58-830c-b20044a20985 None admin] PATH_INFO: `/v3/services/image` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:44.990940 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67404751-275b-4e58-830c-b20044a20985 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:44.992521 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67404751-275b-4e58-830c-b20044a20985 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-b17a11db-0eca-4a6f-a2d4-942102d4f657 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:44.995504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:44.996428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:44.997878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:44.997878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:44.997878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:44.997878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:44.997878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:44.997878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:44.997878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:44.997878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:44.997878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:27:44.997878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:44.997878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 325/648] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 19 17:27:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-67404751-275b-4e58-830c-b20044a20985 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:45.007844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:45.008915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:27:45.009869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:45.010617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a11db-0eca-4a6f-a2d4-942102d4f657 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:45.016996 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 324/649] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Aug 19 17:27:44 2022] GET /identity/v3/services/image => generated 86 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:45.018647 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67404751-275b-4e58-830c-b20044a20985 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:45.083353 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:45.085573 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:45.148452 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a11db-0eca-4a6f-a2d4-942102d4f657 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:45.158699 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67404751-275b-4e58-830c-b20044a20985 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:45.198177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779164df-3fdf-4c61-8907-b5a099b58dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:45.199402 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779164df-3fdf-4c61-8907-b5a099b58dc2 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:45.200002 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779164df-3fdf-4c61-8907-b5a099b58dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:45.200450 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab0918-3e43-46e5-8652-d92914581645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:45.200788 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779164df-3fdf-4c61-8907-b5a099b58dc2 None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:45.201103 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab0918-3e43-46e5-8652-d92914581645 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:45.201384 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab0918-3e43-46e5-8652-d92914581645 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:45.201656 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab0918-3e43-46e5-8652-d92914581645 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:45.202282 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab0918-3e43-46e5-8652-d92914581645 None admin] RBAC: Adding query filter params (name=image) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:45.202555 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779164df-3fdf-4c61-8907-b5a099b58dc2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:45.202673 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab0918-3e43-46e5-8652-d92914581645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:45.203176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779164df-3fdf-4c61-8907-b5a099b58dc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:45.203944 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab0918-3e43-46e5-8652-d92914581645 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:45.205296 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779164df-3fdf-4c61-8907-b5a099b58dc2 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:45.213010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 325/650] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:45.217814 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab0918-3e43-46e5-8652-d92914581645 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:45.235188 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 326/651] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 19 17:27:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:45.236516 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779164df-3fdf-4c61-8907-b5a099b58dc2 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:45.325760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab0918-3e43-46e5-8652-d92914581645 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:45.336144 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:45.347017 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779164df-3fdf-4c61-8907-b5a099b58dc2 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:45.367594 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:45.368113 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a0058-3556-46c7-9099-89335818b55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:45.369137 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a0058-3556-46c7-9099-89335818b55f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:45.369654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a0058-3556-46c7-9099-89335818b55f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:45.370133 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a0058-3556-46c7-9099-89335818b55f None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:45.370995 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a0058-3556-46c7-9099-89335818b55f None admin] RBAC: Adding query filter params (type=image) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:45.371516 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a0058-3556-46c7-9099-89335818b55f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:45.373297 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a0058-3556-46c7-9099-89335818b55f None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:45.385241 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 326/652] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:45.393668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba3bcc-df48-4d41-9390-bbf3f5330e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:45.394285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba3bcc-df48-4d41-9390-bbf3f5330e50 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:45.394564 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba3bcc-df48-4d41-9390-bbf3f5330e50 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:45.394821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba3bcc-df48-4d41-9390-bbf3f5330e50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:45.481550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba3bcc-df48-4d41-9390-bbf3f5330e50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:45.482990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba3bcc-df48-4d41-9390-bbf3f5330e50 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:45.553218 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca947a-bc1a-474c-bdc3-e0a498b74ecf None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:45.553847 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca947a-bc1a-474c-bdc3-e0a498b74ecf None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:45.554371 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca947a-bc1a-474c-bdc3-e0a498b74ecf None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:45.556779 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 327/653] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:45.562608 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17fb03-1184-426a-a982-5992427c41d5 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:45.563233 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17fb03-1184-426a-a982-5992427c41d5 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:45.563726 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17fb03-1184-426a-a982-5992427c41d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:45.582976 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-af17fb03-1184-426a-a982-5992427c41d5 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:45.584531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-af17fb03-1184-426a-a982-5992427c41d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:45.598461 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 327/654] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:27:45.604770 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba3bcc-df48-4d41-9390-bbf3f5330e50 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:45.620093 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:45.672747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 328/655] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:27:45.672747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9648f3-63dd-4652-a2f9-077dc3d76c9a None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:45.672747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9648f3-63dd-4652-a2f9-077dc3d76c9a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:45.672747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9648f3-63dd-4652-a2f9-077dc3d76c9a None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:45.672747 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 329/656] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:45.674428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd3119-b7dd-48ef-8a74-02baee4e76a1 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:45.675409 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd3119-b7dd-48ef-8a74-02baee4e76a1 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:45.675684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd3119-b7dd-48ef-8a74-02baee4e76a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:45.695078 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-4edd3119-b7dd-48ef-8a74-02baee4e76a1 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:45.696362 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-4edd3119-b7dd-48ef-8a74-02baee4e76a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:45.721885 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba3bcc-df48-4d41-9390-bbf3f5330e50 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:45.758198 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767638cb-f53f-49bd-99ae-b2453d4bb1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:45.759203 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767638cb-f53f-49bd-99ae-b2453d4bb1f3 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:45.759699 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767638cb-f53f-49bd-99ae-b2453d4bb1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:45.760177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767638cb-f53f-49bd-99ae-b2453d4bb1f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:45.770601 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 330/657] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:45.771633 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767638cb-f53f-49bd-99ae-b2453d4bb1f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:45.773383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767638cb-f53f-49bd-99ae-b2453d4bb1f3 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-767638cb-f53f-49bd-99ae-b2453d4bb1f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:45.789338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:45.790356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:45.791234 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:45.791234 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:45.791234 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:45.793034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 328/658] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:45.798731 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd3119-b7dd-48ef-8a74-02baee4e76a1 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:45.834190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:45.905630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd3119-b7dd-48ef-8a74-02baee4e76a1 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:45.945909 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89a3bb-101f-4bad-9922-38e041fce067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:45.946527 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89a3bb-101f-4bad-9922-38e041fce067 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:45.946808 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89a3bb-101f-4bad-9922-38e041fce067 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:45.947067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89a3bb-101f-4bad-9922-38e041fce067 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:45.947744 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89a3bb-101f-4bad-9922-38e041fce067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:45.948039 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89a3bb-101f-4bad-9922-38e041fce067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:45.949431 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89a3bb-101f-4bad-9922-38e041fce067 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:45.961385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 331/659] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:45.966793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767638cb-f53f-49bd-99ae-b2453d4bb1f3 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:46.011431 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89a3bb-101f-4bad-9922-38e041fce067 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:46.035870 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:46.073404 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767638cb-f53f-49bd-99ae-b2453d4bb1f3 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:46.112754 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d3a56-b0ca-4277-9849-d7024c4a87bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:46.112754 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d3a56-b0ca-4277-9849-d7024c4a87bc None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:46.112754 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d3a56-b0ca-4277-9849-d7024c4a87bc None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:46.112754 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d3a56-b0ca-4277-9849-d7024c4a87bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:46.117973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d3a56-b0ca-4277-9849-d7024c4a87bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:46.120195 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d3a56-b0ca-4277-9849-d7024c4a87bc None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-195d3a56-b0ca-4277-9849-d7024c4a87bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:46.131724 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:46.132685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:46.133644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:46.133644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:46.133644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:46.133644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:46.133644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:46.133644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:46.133644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:46.133644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:46.133644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 329/660] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:46.134157 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d3a56-b0ca-4277-9849-d7024c4a87bc None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:46.135757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:46.144760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89a3bb-101f-4bad-9922-38e041fce067 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:46.180834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b497564-1666-4e13-9c97-926549ee2e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:46.182032 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b497564-1666-4e13-9c97-926549ee2e6b None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:46.182312 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b497564-1666-4e13-9c97-926549ee2e6b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:46.182583 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b497564-1666-4e13-9c97-926549ee2e6b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:46.183157 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b497564-1666-4e13-9c97-926549ee2e6b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:46.184517 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b497564-1666-4e13-9c97-926549ee2e6b None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-0b497564-1666-4e13-9c97-926549ee2e6b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:46.193040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:46.194006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:46.194867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 332/661] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Aug 19 17:27:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:46.195692 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b497564-1666-4e13-9c97-926549ee2e6b None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:46.248689 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d3a56-b0ca-4277-9849-d7024c4a87bc None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:46.285950 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:46.295567 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed9f6a-6c7a-4dcc-a956-eee7ff7952be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:46.296185 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed9f6a-6c7a-4dcc-a956-eee7ff7952be None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:46.298384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed9f6a-6c7a-4dcc-a956-eee7ff7952be None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:46.298384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed9f6a-6c7a-4dcc-a956-eee7ff7952be None admin] PATH_INFO: `/v3/services/network` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:46.298384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed9f6a-6c7a-4dcc-a956-eee7ff7952be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:46.298961 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed9f6a-6c7a-4dcc-a956-eee7ff7952be None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-28ed9f6a-6c7a-4dcc-a956-eee7ff7952be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:46.309701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:46.310680 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:27:46.311537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:46.312268 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b497564-1666-4e13-9c97-926549ee2e6b None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:46.312342 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 330/662] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:46 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:46.312342 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed9f6a-6c7a-4dcc-a956-eee7ff7952be None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:46.352018 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dc197-1b2a-40fa-a5f8-4b511fb7af7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:46.352625 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc197-1b2a-40fa-a5f8-4b511fb7af7c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:46.353512 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc197-1b2a-40fa-a5f8-4b511fb7af7c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:46.353791 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc197-1b2a-40fa-a5f8-4b511fb7af7c None admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:46.354478 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc197-1b2a-40fa-a5f8-4b511fb7af7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:46.354787 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc197-1b2a-40fa-a5f8-4b511fb7af7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:46.356237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc197-1b2a-40fa-a5f8-4b511fb7af7c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:46.373661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 333/663] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:46.373661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dc197-1b2a-40fa-a5f8-4b511fb7af7c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:46.390417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:46.431351 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed9f6a-6c7a-4dcc-a956-eee7ff7952be None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:46.476149 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185abbb-829a-4dfa-a78d-048272e9d3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:46.476775 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185abbb-829a-4dfa-a78d-048272e9d3de None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:46.477060 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185abbb-829a-4dfa-a78d-048272e9d3de None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:46.477331 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185abbb-829a-4dfa-a78d-048272e9d3de None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:46.478521 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185abbb-829a-4dfa-a78d-048272e9d3de None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:46.478951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185abbb-829a-4dfa-a78d-048272e9d3de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:46.480215 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185abbb-829a-4dfa-a78d-048272e9d3de None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:46.481032 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dc197-1b2a-40fa-a5f8-4b511fb7af7c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:46.486203 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 331/664] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 19 17:27:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:46.486885 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185abbb-829a-4dfa-a78d-048272e9d3de None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:46.529534 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2e4cb-a61b-4ca3-a6d0-2e1d61459d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:46.530141 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2e4cb-a61b-4ca3-a6d0-2e1d61459d48 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:46.530420 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2e4cb-a61b-4ca3-a6d0-2e1d61459d48 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:46.530846 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2e4cb-a61b-4ca3-a6d0-2e1d61459d48 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:46.531310 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2e4cb-a61b-4ca3-a6d0-2e1d61459d48 None admin] RBAC: Adding query filter params (name=network) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:46.531610 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2e4cb-a61b-4ca3-a6d0-2e1d61459d48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:46.533012 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2e4cb-a61b-4ca3-a6d0-2e1d61459d48 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:46.544624 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 334/665] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:27:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:46.544624 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2e4cb-a61b-4ca3-a6d0-2e1d61459d48 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:46.560608 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:46.610110 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185abbb-829a-4dfa-a78d-048272e9d3de None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:46.633851 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:46.649698 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca9723-5ad2-45e4-b720-4e7f401484db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:46.651109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca9723-5ad2-45e4-b720-4e7f401484db None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:46.651661 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca9723-5ad2-45e4-b720-4e7f401484db None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:46.651938 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca9723-5ad2-45e4-b720-4e7f401484db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:46.652650 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca9723-5ad2-45e4-b720-4e7f401484db None admin] RBAC: Adding query filter params (role.id=17791940429e48ac98d4bd49aa53a88c, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=fb1c954936f64051b09afba8df544ec7) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:46.652986 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca9723-5ad2-45e4-b720-4e7f401484db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:46.653414 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2e4cb-a61b-4ca3-a6d0-2e1d61459d48 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:46.654425 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca9723-5ad2-45e4-b720-4e7f401484db None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:46.661339 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 332/666] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:27:46 2022] GET /identity/v3/role_assignments?user.id=fb1c954936f64051b09afba8df544ec7&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=17791940429e48ac98d4bd49aa53a88c => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:46.662117 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca9723-5ad2-45e4-b720-4e7f401484db None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:46.704295 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa296588-637e-4578-ad9d-344870a1a23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:46.704949 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa296588-637e-4578-ad9d-344870a1a23d None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:46.705231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa296588-637e-4578-ad9d-344870a1a23d None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:46.705502 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa296588-637e-4578-ad9d-344870a1a23d None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:46.706143 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa296588-637e-4578-ad9d-344870a1a23d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:46.706446 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa296588-637e-4578-ad9d-344870a1a23d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:46.707909 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa296588-637e-4578-ad9d-344870a1a23d None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:46.714194 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 335/667] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 19 17:27:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:46.801778 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca9723-5ad2-45e4-b720-4e7f401484db None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:46.823290 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:46.844232 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2be75-f910-4fab-bb87-8c55fb9e0007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:46.844896 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2be75-f910-4fab-bb87-8c55fb9e0007 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:46.845175 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2be75-f910-4fab-bb87-8c55fb9e0007 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:46.845444 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2be75-f910-4fab-bb87-8c55fb9e0007 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:46.846090 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2be75-f910-4fab-bb87-8c55fb9e0007 None admin] RBAC: Adding query filter params (type=network) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:46.846391 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2be75-f910-4fab-bb87-8c55fb9e0007 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:46.847830 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2be75-f910-4fab-bb87-8c55fb9e0007 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:46.854787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 333/668] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:27:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:47.679960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f3ea5-2fa9-4561-a914-fa7b3e9c10ad None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:47.680452 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f3ea5-2fa9-4561-a914-fa7b3e9c10ad None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:47.680452 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f3ea5-2fa9-4561-a914-fa7b3e9c10ad None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:47.682585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 336/669] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:47.687677 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157a90a-14db-4416-a363-ec281c317808 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:47.688082 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157a90a-14db-4416-a363-ec281c317808 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:47.688264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157a90a-14db-4416-a363-ec281c317808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:47.706864 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-7157a90a-14db-4416-a363-ec281c317808 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:47.708122 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-7157a90a-14db-4416-a363-ec281c317808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:47.782068 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 334/670] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:48.108010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f3ea5-2fa9-4561-a914-fa7b3e9c10ad None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:48.213282 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f3ea5-2fa9-4561-a914-fa7b3e9c10ad None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:48.247323 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241ef78-b742-4d46-9836-efd93500d908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:48.247919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ef78-b742-4d46-9836-efd93500d908 None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:48.248196 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ef78-b742-4d46-9836-efd93500d908 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:48.248465 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241ef78-b742-4d46-9836-efd93500d908 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:48.249155 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241ef78-b742-4d46-9836-efd93500d908 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:48.250509 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241ef78-b742-4d46-9836-efd93500d908 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:48.351519 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 337/671] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 19 17:27:48 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:27:48.905599 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6051d-bb9d-4ccb-b243-0690e631d9eb None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:48.906096 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6051d-bb9d-4ccb-b243-0690e631d9eb None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:48.906096 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6051d-bb9d-4ccb-b243-0690e631d9eb None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:48.907643 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 335/672] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:48.913123 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199ebd6-f2d3-46ff-b1b1-6730b28e0e57 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:48.913999 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199ebd6-f2d3-46ff-b1b1-6730b28e0e57 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:48.914474 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199ebd6-f2d3-46ff-b1b1-6730b28e0e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:48.922675 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:48.934623 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-e199ebd6-f2d3-46ff-b1b1-6730b28e0e57 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:48.938759 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-e199ebd6-f2d3-46ff-b1b1-6730b28e0e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:49.026295 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 338/673] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:48 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:49.058174 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b6bd-5d82-446d-a1a8-bef2f2673448 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:49.058487 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b6bd-5d82-446d-a1a8-bef2f2673448 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:49.058728 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b6bd-5d82-446d-a1a8-bef2f2673448 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:49.060046 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 336/674] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:49.065522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f86b8-af3d-44ed-94e0-75ffb143968d None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:49.065810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f86b8-af3d-44ed-94e0-75ffb143968d None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:49.066085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f86b8-af3d-44ed-94e0-75ffb143968d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:49.084716 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-599f86b8-af3d-44ed-94e0-75ffb143968d None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:49.089849 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-599f86b8-af3d-44ed-94e0-75ffb143968d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:49.114602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81795227-0554-4794-bff2-85d0770d6c1f None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:49.114911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81795227-0554-4794-bff2-85d0770d6c1f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:49.115164 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81795227-0554-4794-bff2-85d0770d6c1f None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:49.116741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 337/675] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:27:49.122133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7065a8-fe27-4cb2-843b-4123e80649ec None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:49.122417 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7065a8-fe27-4cb2-843b-4123e80649ec None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:49.127809 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7065a8-fe27-4cb2-843b-4123e80649ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:49.140488 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-1c7065a8-fe27-4cb2-843b-4123e80649ec None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:49.141711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-1c7065a8-fe27-4cb2-843b-4123e80649ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:49.168941 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 339/676] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:49 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:49.221328 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 338/677] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:49 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:27:49.372547 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f86b8-af3d-44ed-94e0-75ffb143968d None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:49.433246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:49.479607 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f86b8-af3d-44ed-94e0-75ffb143968d None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:49.496014 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7065a8-fe27-4cb2-843b-4123e80649ec None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:49.525118 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dec99a-e3c6-46f8-99e8-2174c41b048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:49.525118 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dec99a-e3c6-46f8-99e8-2174c41b048f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:49.525118 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dec99a-e3c6-46f8-99e8-2174c41b048f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:49.525118 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dec99a-e3c6-46f8-99e8-2174c41b048f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:49.541975 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dec99a-e3c6-46f8-99e8-2174c41b048f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-b0dec99a-e3c6-46f8-99e8-2174c41b048f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:49.548887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:49.549822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:49.551064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 340/678] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:27:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:49.555859 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dec99a-e3c6-46f8-99e8-2174c41b048f None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:49.561000 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:49.624645 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7065a8-fe27-4cb2-843b-4123e80649ec None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:49.666061 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dec99a-e3c6-46f8-99e8-2174c41b048f None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:49.666384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16796d45-0719-4314-a15e-843dfafd9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:49.666935 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16796d45-0719-4314-a15e-843dfafd9ed2 None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:49.667211 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16796d45-0719-4314-a15e-843dfafd9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:49.667503 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16796d45-0719-4314-a15e-843dfafd9ed2 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:49.668108 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16796d45-0719-4314-a15e-843dfafd9ed2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:49.669497 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16796d45-0719-4314-a15e-843dfafd9ed2 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:49.694821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:49.700394 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b287eb6-8e5c-4898-b47e-4a64814e1342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:49.701018 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b287eb6-8e5c-4898-b47e-4a64814e1342 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:49.701296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b287eb6-8e5c-4898-b47e-4a64814e1342 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:49.701614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b287eb6-8e5c-4898-b47e-4a64814e1342 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:49.702268 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b287eb6-8e5c-4898-b47e-4a64814e1342 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:49.702567 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b287eb6-8e5c-4898-b47e-4a64814e1342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:49.703919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b287eb6-8e5c-4898-b47e-4a64814e1342 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:49.711576 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 341/679] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:49.712923 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b287eb6-8e5c-4898-b47e-4a64814e1342 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:49.745156 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 339/680] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 19 17:27:49 2022] POST /identity/v3/services => generated 251 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:27:49.747159 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16796d45-0719-4314-a15e-843dfafd9ed2 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:49.826188 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b287eb6-8e5c-4898-b47e-4a64814e1342 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:49.886305 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4066026-2a08-4e44-b9c5-3b11712f9b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:49.887081 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4066026-2a08-4e44-b9c5-3b11712f9b8c None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:49.887469 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4066026-2a08-4e44-b9c5-3b11712f9b8c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:49.887755 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4066026-2a08-4e44-b9c5-3b11712f9b8c None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:49.888474 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4066026-2a08-4e44-b9c5-3b11712f9b8c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:49.890749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4066026-2a08-4e44-b9c5-3b11712f9b8c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:49.897835 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16796d45-0719-4314-a15e-843dfafd9ed2 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:49.900415 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:49.935208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464421b-59ee-4655-bbd7-850c85d2696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:49.935986 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464421b-59ee-4655-bbd7-850c85d2696c None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:49.936202 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464421b-59ee-4655-bbd7-850c85d2696c None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:49.936475 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464421b-59ee-4655-bbd7-850c85d2696c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:49.948005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464421b-59ee-4655-bbd7-850c85d2696c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:49.949540 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464421b-59ee-4655-bbd7-850c85d2696c None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-8464421b-59ee-4655-bbd7-850c85d2696c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:49.964877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:49.965913 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:49.966826 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:49.966826 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:49.966826 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:49.966826 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 340/681] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:49.968651 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 342/682] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 19 17:27:49 2022] POST /identity/v3/services => generated 240 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:27:49.981181 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464421b-59ee-4655-bbd7-850c85d2696c None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:50.105504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464421b-59ee-4655-bbd7-850c85d2696c None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:50.153137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744fd85-944d-4107-9869-542f0a9c74f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:50.155205 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744fd85-944d-4107-9869-542f0a9c74f9 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:50.155205 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744fd85-944d-4107-9869-542f0a9c74f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:50.155205 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744fd85-944d-4107-9869-542f0a9c74f9 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:50.155205 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744fd85-944d-4107-9869-542f0a9c74f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:50.155205 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744fd85-944d-4107-9869-542f0a9c74f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:50.157591 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744fd85-944d-4107-9869-542f0a9c74f9 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:50.169663 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 341/683] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:50.180336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4066026-2a08-4e44-b9c5-3b11712f9b8c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:50.222142 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:50.290707 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4066026-2a08-4e44-b9c5-3b11712f9b8c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:50.333391 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09ab9-2ba6-4915-bb7d-64b418ebd9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:50.334034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09ab9-2ba6-4915-bb7d-64b418ebd9ee None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:50.334307 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09ab9-2ba6-4915-bb7d-64b418ebd9ee None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:50.334581 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09ab9-2ba6-4915-bb7d-64b418ebd9ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:50.342465 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09ab9-2ba6-4915-bb7d-64b418ebd9ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:50.344030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09ab9-2ba6-4915-bb7d-64b418ebd9ee None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-b3b09ab9-2ba6-4915-bb7d-64b418ebd9ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:50.356960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:50.357928 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:50.358889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:50.358889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:50.358889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:50.358889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:50.358889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:50.358889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:50.358889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:50.358889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:50.358889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:27:50.358889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:50.358889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 343/684] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 19 17:27:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:50.363628 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744fd85-944d-4107-9869-542f0a9c74f9 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:50.377246 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:50.468978 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744fd85-944d-4107-9869-542f0a9c74f9 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:50.504888 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f856b-3cbe-46ae-94f0-29be53541b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:50.505416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f856b-3cbe-46ae-94f0-29be53541b93 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:50.505698 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f856b-3cbe-46ae-94f0-29be53541b93 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:50.505970 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f856b-3cbe-46ae-94f0-29be53541b93 None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:50.506696 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f856b-3cbe-46ae-94f0-29be53541b93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:50.507000 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f856b-3cbe-46ae-94f0-29be53541b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:50.508422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f856b-3cbe-46ae-94f0-29be53541b93 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:50.528574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 342/685] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 19 17:27:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:50.534372 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09ab9-2ba6-4915-bb7d-64b418ebd9ee None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:50.643725 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:50.647586 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09ab9-2ba6-4915-bb7d-64b418ebd9ee None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:50.683160 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0735f6-5c42-409e-b4c5-2f897d05812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:50.683791 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0735f6-5c42-409e-b4c5-2f897d05812e None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:50.684064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0735f6-5c42-409e-b4c5-2f897d05812e None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:50.684332 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0735f6-5c42-409e-b4c5-2f897d05812e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:50.686877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad71e6-36fb-482a-b98b-0119677730e3 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:50.687167 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad71e6-36fb-482a-b98b-0119677730e3 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:50.687445 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad71e6-36fb-482a-b98b-0119677730e3 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:50.689042 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 343/686] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:27:50.693803 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0659a2a-31a0-45bf-a9c1-978b46c5511b None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:50.694086 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0659a2a-31a0-45bf-a9c1-978b46c5511b None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:50.694357 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0659a2a-31a0-45bf-a9c1-978b46c5511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:50.696082 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0735f6-5c42-409e-b4c5-2f897d05812e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:50.697790 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0735f6-5c42-409e-b4c5-2f897d05812e None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-9c0735f6-5c42-409e-b4c5-2f897d05812e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:50.713533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:50.714490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:50.715360 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:50.715360 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:50.715360 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:50.715555 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-a0659a2a-31a0-45bf-a9c1-978b46c5511b None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:50.716222 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-a0659a2a-31a0-45bf-a9c1-978b46c5511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:50.717897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 344/687] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:50.723860 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0735f6-5c42-409e-b4c5-2f897d05812e None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:50.802899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:50.816841 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 344/688] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:50 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:27:50.854113 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0735f6-5c42-409e-b4c5-2f897d05812e None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:50.877510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d592c-a9a7-4794-b77a-455cf9b57acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:50.878542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d592c-a9a7-4794-b77a-455cf9b57acb None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:50.879022 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d592c-a9a7-4794-b77a-455cf9b57acb None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:50.879477 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d592c-a9a7-4794-b77a-455cf9b57acb None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:50.880314 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d592c-a9a7-4794-b77a-455cf9b57acb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:50.880828 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d592c-a9a7-4794-b77a-455cf9b57acb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:50.882385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d592c-a9a7-4794-b77a-455cf9b57acb None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:50.895534 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 345/689] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:50.901746 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0659a2a-31a0-45bf-a9c1-978b46c5511b None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:51.017234 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0659a2a-31a0-45bf-a9c1-978b46c5511b None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:51.055328 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bcca0-a921-4fe6-b58b-f7a32e87eeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:51.055907 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bcca0-a921-4fe6-b58b-f7a32e87eeb0 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:51.056188 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bcca0-a921-4fe6-b58b-f7a32e87eeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:51.056462 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bcca0-a921-4fe6-b58b-f7a32e87eeb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:51.063169 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bcca0-a921-4fe6-b58b-f7a32e87eeb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:51.064604 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bcca0-a921-4fe6-b58b-f7a32e87eeb0 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-ed1bcca0-a921-4fe6-b58b-f7a32e87eeb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:51.076064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:51.082123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:51.083052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:51.083052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:51.083052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:51.083052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:51.083052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:51.083052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:51.083052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:51.083052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:51.083052 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 345/690] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:51.085616 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d592c-a9a7-4794-b77a-455cf9b57acb None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:51.105134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:51.173385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bcca0-a921-4fe6-b58b-f7a32e87eeb0 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:51.199421 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d592c-a9a7-4794-b77a-455cf9b57acb None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:51.233338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:51.235830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564894-4b35-4ccd-a48b-0a4bf83a8c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:51.236424 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564894-4b35-4ccd-a48b-0a4bf83a8c6b None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:51.236701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564894-4b35-4ccd-a48b-0a4bf83a8c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:51.236999 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564894-4b35-4ccd-a48b-0a4bf83a8c6b None admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:51.237679 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d564894-4b35-4ccd-a48b-0a4bf83a8c6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:51.237977 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d564894-4b35-4ccd-a48b-0a4bf83a8c6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:51.239388 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d564894-4b35-4ccd-a48b-0a4bf83a8c6b None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:51.253302 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 346/691] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:51.259494 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564894-4b35-4ccd-a48b-0a4bf83a8c6b None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:51.280895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bcca0-a921-4fe6-b58b-f7a32e87eeb0 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:51.327203 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c080fcd-c2c4-4c38-8f74-2dfdcd4a7357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:51.327752 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c080fcd-c2c4-4c38-8f74-2dfdcd4a7357 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:51.328030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c080fcd-c2c4-4c38-8f74-2dfdcd4a7357 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:51.328303 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c080fcd-c2c4-4c38-8f74-2dfdcd4a7357 None admin] PATH_INFO: `/v3/services/image` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:51.328912 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c080fcd-c2c4-4c38-8f74-2dfdcd4a7357 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:51.330286 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c080fcd-c2c4-4c38-8f74-2dfdcd4a7357 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-5c080fcd-c2c4-4c38-8f74-2dfdcd4a7357 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:51.339091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:51.342147 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:27:51.343036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:51.345232 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 346/692] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Aug 19 17:27:51 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:51.346065 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c080fcd-c2c4-4c38-8f74-2dfdcd4a7357 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:51.349712 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:51.403882 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564894-4b35-4ccd-a48b-0a4bf83a8c6b None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:51.455788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fafae-4376-4637-b5ca-0a93f5016ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:51.456854 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fafae-4376-4637-b5ca-0a93f5016ff0 None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:51.457284 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fafae-4376-4637-b5ca-0a93f5016ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:51.457697 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fafae-4376-4637-b5ca-0a93f5016ff0 None admin] PATH_INFO: `/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/fb1c954936f64051b09afba8df544ec7/roles/17791940429e48ac98d4bd49aa53a88c` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:51.460396 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fafae-4376-4637-b5ca-0a93f5016ff0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b84e7b6ac1644538bb6ef2874a1f0cf, user_id=fb1c954936f64051b09afba8df544ec7, role_id=17791940429e48ac98d4bd49aa53a88c)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:51.463157 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fafae-4376-4637-b5ca-0a93f5016ff0 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:51.467400 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c080fcd-c2c4-4c38-8f74-2dfdcd4a7357 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:51.490795 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:51.503423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d9de3-2010-470f-9364-d6ba1a6000e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:51.504172 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d9de3-2010-470f-9364-d6ba1a6000e0 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:51.504457 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d9de3-2010-470f-9364-d6ba1a6000e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:51.504749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d9de3-2010-470f-9364-d6ba1a6000e0 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:51.505370 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d9de3-2010-470f-9364-d6ba1a6000e0 None admin] RBAC: Adding query filter params (name=image) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:51.505714 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d9de3-2010-470f-9364-d6ba1a6000e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:51.507124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d9de3-2010-470f-9364-d6ba1a6000e0 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:51.512863 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 347/693] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:51.517668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d9de3-2010-470f-9364-d6ba1a6000e0 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:51.536158 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 347/694] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:27:51 2022] PUT /identity/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/fb1c954936f64051b09afba8df544ec7/roles/17791940429e48ac98d4bd49aa53a88c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:27:51.638649 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d9de3-2010-470f-9364-d6ba1a6000e0 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:51.676772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1bd9a-6ebd-4e0b-89bc-d5d53286bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:51.677763 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1bd9a-6ebd-4e0b-89bc-d5d53286bed3 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:51.678278 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1bd9a-6ebd-4e0b-89bc-d5d53286bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:51.678739 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1bd9a-6ebd-4e0b-89bc-d5d53286bed3 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:51.679540 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1bd9a-6ebd-4e0b-89bc-d5d53286bed3 None admin] RBAC: Adding query filter params (type=image) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:51.679988 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1bd9a-6ebd-4e0b-89bc-d5d53286bed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:51.682123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1bd9a-6ebd-4e0b-89bc-d5d53286bed3 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:51.688337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 348/695] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:51.694849 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fafae-4376-4637-b5ca-0a93f5016ff0 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:51.807893 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fafae-4376-4637-b5ca-0a93f5016ff0 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:51.837106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:51.843476 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa3aa1-3fbc-492b-b0e4-ca2bc18f7c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:51.844160 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa3aa1-3fbc-492b-b0e4-ca2bc18f7c30 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:51.844505 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa3aa1-3fbc-492b-b0e4-ca2bc18f7c30 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:51.844870 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa3aa1-3fbc-492b-b0e4-ca2bc18f7c30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:51.845641 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa3aa1-3fbc-492b-b0e4-ca2bc18f7c30 None admin] RBAC: Adding query filter params (interface=public, service_id=1b8c0f6b77504ee4a1b93116ca05082c, region_id=RegionOne) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:51.846006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa3aa1-3fbc-492b-b0e4-ca2bc18f7c30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:51.857294 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa3aa1-3fbc-492b-b0e4-ca2bc18f7c30 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:51.857294 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 348/696] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 19 17:27:51 2022] GET /identity/v3/endpoints?service_id=1b8c0f6b77504ee4a1b93116ca05082c&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:51.861848 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1bd9a-6ebd-4e0b-89bc-d5d53286bed3 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:51.914998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:51.968746 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1bd9a-6ebd-4e0b-89bc-d5d53286bed3 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:52.008890 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233e88f-e1f8-49fa-b358-e429519ba6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:52.009676 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233e88f-e1f8-49fa-b358-e429519ba6c1 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:52.010075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233e88f-e1f8-49fa-b358-e429519ba6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:52.010446 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233e88f-e1f8-49fa-b358-e429519ba6c1 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:52.011201 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233e88f-e1f8-49fa-b358-e429519ba6c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:52.012811 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233e88f-e1f8-49fa-b358-e429519ba6c1 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:52.018644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 349/697] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 19 17:27:51 2022] GET /identity/v3/services => generated 1002 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:27:52.137886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b64939-d363-4a61-871e-7cd7eb1c5806 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:52.138417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b64939-d363-4a61-871e-7cd7eb1c5806 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:52.138417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b64939-d363-4a61-871e-7cd7eb1c5806 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:52.140071 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 349/698] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:52.145707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05c160-9bf9-489b-9b8e-4bd3c0e2ea7f None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:52.146255 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05c160-9bf9-489b-9b8e-4bd3c0e2ea7f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:52.146629 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05c160-9bf9-489b-9b8e-4bd3c0e2ea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:52.180456 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-ce05c160-9bf9-489b-9b8e-4bd3c0e2ea7f None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:52.180456 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-ce05c160-9bf9-489b-9b8e-4bd3c0e2ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:52.253557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 350/699] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:27:52.368927 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf94c-4c67-438f-ac42-e5c45e98ddc8 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:52.369728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf94c-4c67-438f-ac42-e5c45e98ddc8 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:52.369728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf94c-4c67-438f-ac42-e5c45e98ddc8 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:52.371102 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 350/700] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:52.376514 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f63c-bd7e-4430-b8eb-e622f0b74d46 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:52.376844 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f63c-bd7e-4430-b8eb-e622f0b74d46 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:52.377128 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f63c-bd7e-4430-b8eb-e622f0b74d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:52.395377 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-1b18f63c-bd7e-4430-b8eb-e622f0b74d46 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:52.396561 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-1b18f63c-bd7e-4430-b8eb-e622f0b74d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:52.439424 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:52.466594 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 351/701] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:27:52.600109 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdf94c-4c67-438f-ac42-e5c45e98ddc8 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:52.705533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdf94c-4c67-438f-ac42-e5c45e98ddc8 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:52.740304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f9f59-9b44-449b-a42f-256ec377186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:52.740964 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f9f59-9b44-449b-a42f-256ec377186c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:52.741245 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f9f59-9b44-449b-a42f-256ec377186c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:52.741515 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f9f59-9b44-449b-a42f-256ec377186c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:52.742093 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f9f59-9b44-449b-a42f-256ec377186c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:52.743478 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f9f59-9b44-449b-a42f-256ec377186c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-041f9f59-9b44-449b-a42f-256ec377186c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:52.752749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:52.753762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:52.754614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 351/702] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Aug 19 17:27:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:52.760782 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18f63c-bd7e-4430-b8eb-e622f0b74d46 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:52.794610 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f9f59-9b44-449b-a42f-256ec377186c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:52.861052 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:52.876120 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18f63c-bd7e-4430-b8eb-e622f0b74d46 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:52.906355 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f9f59-9b44-449b-a42f-256ec377186c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:52.910503 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322db8e9-8cdf-4540-98d9-db87723f97a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:52.911167 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322db8e9-8cdf-4540-98d9-db87723f97a4 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:52.911436 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322db8e9-8cdf-4540-98d9-db87723f97a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:52.911710 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322db8e9-8cdf-4540-98d9-db87723f97a4 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:52.912391 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322db8e9-8cdf-4540-98d9-db87723f97a4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:52.912698 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322db8e9-8cdf-4540-98d9-db87723f97a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:52.914255 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322db8e9-8cdf-4540-98d9-db87723f97a4 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:52.924753 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 352/703] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 19 17:27:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:52.925781 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322db8e9-8cdf-4540-98d9-db87723f97a4 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:52.972347 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:53.041212 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322db8e9-8cdf-4540-98d9-db87723f97a4 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:53.077166 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb82352-51a5-4b1b-9803-59e2f2f7ab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:53.077762 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb82352-51a5-4b1b-9803-59e2f2f7ab9a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:53.078003 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dbca8-0ceb-4b02-8b07-6aba2d26ba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:53.078123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb82352-51a5-4b1b-9803-59e2f2f7ab9a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:53.078297 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb82352-51a5-4b1b-9803-59e2f2f7ab9a None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:53.085091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb82352-51a5-4b1b-9803-59e2f2f7ab9a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:53.085204 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dbca8-0ceb-4b02-8b07-6aba2d26ba9a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:53.085283 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb82352-51a5-4b1b-9803-59e2f2f7ab9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:53.085355 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dbca8-0ceb-4b02-8b07-6aba2d26ba9a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:53.085355 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dbca8-0ceb-4b02-8b07-6aba2d26ba9a None admin] PATH_INFO: `/v3/services/network` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:53.085355 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dbca8-0ceb-4b02-8b07-6aba2d26ba9a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:53.085555 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb82352-51a5-4b1b-9803-59e2f2f7ab9a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:53.085625 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dbca8-0ceb-4b02-8b07-6aba2d26ba9a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:53.091274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 353/704] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 19 17:27:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:53.092140 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb82352-51a5-4b1b-9803-59e2f2f7ab9a None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-eb7dbca8-0ceb-4b02-8b07-6aba2d26ba9a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:53.093402 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:53.094390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:27:53.095242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:53.102778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 352/705] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:52 2022] GET /identity/v3/services/network => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:53.105045 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dbca8-0ceb-4b02-8b07-6aba2d26ba9a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:53.199227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb82352-51a5-4b1b-9803-59e2f2f7ab9a None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:53.200897 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:53.222269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dbca8-0ceb-4b02-8b07-6aba2d26ba9a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:53.239514 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd26d83-458f-401f-a391-a987aacd59a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:53.240053 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd26d83-458f-401f-a391-a987aacd59a9 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:53.240329 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd26d83-458f-401f-a391-a987aacd59a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:53.240597 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd26d83-458f-401f-a391-a987aacd59a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:53.241311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd26d83-458f-401f-a391-a987aacd59a9 None admin] RBAC: Adding query filter params (interface=public, service_id=6c2b8915d8584c6b918d6f564b14a80a, region_id=RegionOne) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:53.241891 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd26d83-458f-401f-a391-a987aacd59a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:53.244170 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd26d83-458f-401f-a391-a987aacd59a9 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:53.254101 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 354/706] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 19 17:27:53 2022] GET /identity/v3/endpoints?service_id=6c2b8915d8584c6b918d6f564b14a80a&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:53.258547 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:53.259875 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd26d83-458f-401f-a391-a987aacd59a9 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:53.270905 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7774754-a4f1-4eff-86a6-6b0fb16c714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:53.271725 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7774754-a4f1-4eff-86a6-6b0fb16c714b None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:53.272109 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7774754-a4f1-4eff-86a6-6b0fb16c714b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:53.272486 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7774754-a4f1-4eff-86a6-6b0fb16c714b None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:53.273550 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7774754-a4f1-4eff-86a6-6b0fb16c714b None admin] RBAC: Adding query filter params (name=network) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:53.273740 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7774754-a4f1-4eff-86a6-6b0fb16c714b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:53.275741 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7774754-a4f1-4eff-86a6-6b0fb16c714b None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:53.285861 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 353/707] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:27:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:53.287364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7774754-a4f1-4eff-86a6-6b0fb16c714b None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:53.372500 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd26d83-458f-401f-a391-a987aacd59a9 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:53.394884 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7774754-a4f1-4eff-86a6-6b0fb16c714b None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:53.411403 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a3839-5d40-4d29-a80e-1c4d225b4671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:53.412210 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a3839-5d40-4d29-a80e-1c4d225b4671 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:53.412636 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a3839-5d40-4d29-a80e-1c4d225b4671 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:53.413103 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a3839-5d40-4d29-a80e-1c4d225b4671 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:53.414074 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a3839-5d40-4d29-a80e-1c4d225b4671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:53.415785 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a3839-5d40-4d29-a80e-1c4d225b4671 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:53.429185 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 355/708] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 19 17:27:53 2022] GET /identity/v3/services => generated 1002 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:27:53.433374 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffbbe4-1dcc-49bf-aa65-ad2b94b6444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:53.434148 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffbbe4-1dcc-49bf-aa65-ad2b94b6444e None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:53.434529 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffbbe4-1dcc-49bf-aa65-ad2b94b6444e None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:53.434902 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffbbe4-1dcc-49bf-aa65-ad2b94b6444e None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:53.435653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffbbe4-1dcc-49bf-aa65-ad2b94b6444e None admin] RBAC: Adding query filter params (type=network) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:53.436058 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffbbe4-1dcc-49bf-aa65-ad2b94b6444e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:53.437600 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffbbe4-1dcc-49bf-aa65-ad2b94b6444e None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:53.448822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 354/709] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:27:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:53.451042 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a3839-5d40-4d29-a80e-1c4d225b4671 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:53.497442 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:53.564997 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a3839-5d40-4d29-a80e-1c4d225b4671 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:53.605427 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1bcfb-c560-4240-9ac6-0f9f251e3f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:53.606283 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1bcfb-c560-4240-9ac6-0f9f251e3f20 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:53.606728 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1bcfb-c560-4240-9ac6-0f9f251e3f20 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:53.607157 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1bcfb-c560-4240-9ac6-0f9f251e3f20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:53.608015 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1bcfb-c560-4240-9ac6-0f9f251e3f20 None admin] RBAC: Adding query filter params (interface=public, service_id=62dcb63088334dd88e23fe40085727f5, region_id=RegionOne) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:53.608469 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1bcfb-c560-4240-9ac6-0f9f251e3f20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:53.610131 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1bcfb-c560-4240-9ac6-0f9f251e3f20 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:53.616525 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 356/710] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 19 17:27:53 2022] GET /identity/v3/endpoints?service_id=62dcb63088334dd88e23fe40085727f5&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:53.622566 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffbbe4-1dcc-49bf-aa65-ad2b94b6444e None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:53.690204 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:53.742557 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffbbe4-1dcc-49bf-aa65-ad2b94b6444e None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:53.778865 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bf4b4-5a15-4bf8-9448-50d4e8dfa90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:53.779403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bf4b4-5a15-4bf8-9448-50d4e8dfa90f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:53.779689 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bf4b4-5a15-4bf8-9448-50d4e8dfa90f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:53.779960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bf4b4-5a15-4bf8-9448-50d4e8dfa90f None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:53.780576 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bf4b4-5a15-4bf8-9448-50d4e8dfa90f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:53.782008 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bf4b4-5a15-4bf8-9448-50d4e8dfa90f None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:53.792496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 355/711] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 19 17:27:53 2022] GET /identity/v3/services => generated 1002 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:27:53.988010 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be9a2e-1f5e-47f4-b9c4-d3f8d3a13b76 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:53.988333 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be9a2e-1f5e-47f4-b9c4-d3f8d3a13b76 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:53.988559 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be9a2e-1f5e-47f4-b9c4-d3f8d3a13b76 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:53.990187 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 357/712] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:53.995814 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22dd2d-dfd0-4b1f-93a9-9c0ee2464ef8 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:53.996348 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22dd2d-dfd0-4b1f-93a9-9c0ee2464ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:53.996905 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22dd2d-dfd0-4b1f-93a9-9c0ee2464ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:54.016217 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-ac22dd2d-dfd0-4b1f-93a9-9c0ee2464ef8 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:54.017772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-ac22dd2d-dfd0-4b1f-93a9-9c0ee2464ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:54.088065 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 356/713] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:53 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:27:54.308759 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20e267-9bb5-4bb4-99e7-d75466cffa78 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:54.309272 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20e267-9bb5-4bb4-99e7-d75466cffa78 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:54.309348 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20e267-9bb5-4bb4-99e7-d75466cffa78 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:54.310892 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 358/714] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:54.316069 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012a39-ec5a-4c96-88ab-0a59ee210c9d None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:54.316487 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012a39-ec5a-4c96-88ab-0a59ee210c9d None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:54.316645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012a39-ec5a-4c96-88ab-0a59ee210c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:54.334359 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-66012a39-ec5a-4c96-88ab-0a59ee210c9d None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:54.335520 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-66012a39-ec5a-4c96-88ab-0a59ee210c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:54.390387 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:54.450862 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 357/715] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:54 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:27:54.523304 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20e267-9bb5-4bb4-99e7-d75466cffa78 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:54.622567 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:54.630365 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20e267-9bb5-4bb4-99e7-d75466cffa78 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:54.666519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9520e51-983b-4dad-ba7b-1efd6f536bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:54.667158 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9520e51-983b-4dad-ba7b-1efd6f536bde None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:54.667437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9520e51-983b-4dad-ba7b-1efd6f536bde None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:54.667711 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9520e51-983b-4dad-ba7b-1efd6f536bde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:54.678217 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9520e51-983b-4dad-ba7b-1efd6f536bde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-b9520e51-983b-4dad-ba7b-1efd6f536bde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:27:54.683152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:54.684071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:54.685337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 359/716] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:27:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:54.690424 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66012a39-ec5a-4c96-88ab-0a59ee210c9d None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:54.792991 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66012a39-ec5a-4c96-88ab-0a59ee210c9d None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:54.818074 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9520e51-983b-4dad-ba7b-1efd6f536bde None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:54.828956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8411e72-3272-4fe1-86e7-05b7e2ce992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:54.829789 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8411e72-3272-4fe1-86e7-05b7e2ce992a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:54.830375 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8411e72-3272-4fe1-86e7-05b7e2ce992a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:54.830652 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8411e72-3272-4fe1-86e7-05b7e2ce992a None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:54.831311 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8411e72-3272-4fe1-86e7-05b7e2ce992a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:54.831609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8411e72-3272-4fe1-86e7-05b7e2ce992a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:54.833114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8411e72-3272-4fe1-86e7-05b7e2ce992a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:54.847410 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 358/717] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:27:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:54.848443 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8411e72-3272-4fe1-86e7-05b7e2ce992a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:54.883468 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:54.937725 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9520e51-983b-4dad-ba7b-1efd6f536bde None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:54.948971 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8411e72-3272-4fe1-86e7-05b7e2ce992a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:54.974597 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f9bb8-9747-4ebb-a258-945334f97caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:54.975536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f9bb8-9747-4ebb-a258-945334f97caf None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:54.976068 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f9bb8-9747-4ebb-a258-945334f97caf None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:54.976555 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f9bb8-9747-4ebb-a258-945334f97caf None admin] PATH_INFO: `/v3/services/image` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:54.977347 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f9bb8-9747-4ebb-a258-945334f97caf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:54.979196 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f9bb8-9747-4ebb-a258-945334f97caf None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:54.986003 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbfe20-6c6b-4674-83b8-8d8780363d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:54.986631 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbfe20-6c6b-4674-83b8-8d8780363d5a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:54.986907 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbfe20-6c6b-4674-83b8-8d8780363d5a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:54.987173 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbfe20-6c6b-4674-83b8-8d8780363d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-5b9f9bb8-9747-4ebb-a258-945334f97caf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:54.989993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:54.990955 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:27:54.991793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:54.999094 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbfe20-6c6b-4674-83b8-8d8780363d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:54.999259 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbfe20-6c6b-4674-83b8-8d8780363d5a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:54.999515 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 360/718] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Aug 19 17:27:54 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:55.001088 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f9bb8-9747-4ebb-a258-945334f97caf None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-eedbfe20-6c6b-4674-83b8-8d8780363d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:55.019037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:55.020106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:55.021054 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:55.021054 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:55.021054 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:55.025262 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 359/719] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:55.029588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:55.030891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbfe20-6c6b-4674-83b8-8d8780363d5a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:55.115046 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f9bb8-9747-4ebb-a258-945334f97caf None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:55.149310 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:55.161089 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075ae3b-175b-4b88-b9c5-5389593677fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:55.162244 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075ae3b-175b-4b88-b9c5-5389593677fa None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:55.162991 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075ae3b-175b-4b88-b9c5-5389593677fa None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:55.163444 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075ae3b-175b-4b88-b9c5-5389593677fa None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:55.164218 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075ae3b-175b-4b88-b9c5-5389593677fa None admin] RBAC: Adding query filter params (name=image) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:55.164681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075ae3b-175b-4b88-b9c5-5389593677fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:55.164855 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbfe20-6c6b-4674-83b8-8d8780363d5a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:55.166586 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8075ae3b-175b-4b88-b9c5-5389593677fa None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:55.173593 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 361/720] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:55.179519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075ae3b-175b-4b88-b9c5-5389593677fa None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:55.205821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5163b9c-d540-4417-9da1-c79c24f25418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:55.206399 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5163b9c-d540-4417-9da1-c79c24f25418 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:55.206676 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5163b9c-d540-4417-9da1-c79c24f25418 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:55.206943 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5163b9c-d540-4417-9da1-c79c24f25418 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:55.207569 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5163b9c-d540-4417-9da1-c79c24f25418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:55.207961 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5163b9c-d540-4417-9da1-c79c24f25418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:55.209401 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5163b9c-d540-4417-9da1-c79c24f25418 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:55.225372 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 360/721] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:55.226967 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5163b9c-d540-4417-9da1-c79c24f25418 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:55.302132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:55.329849 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075ae3b-175b-4b88-b9c5-5389593677fa None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:55.337562 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5163b9c-d540-4417-9da1-c79c24f25418 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:55.375756 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c80a8-820a-420c-b575-c6cda4a582ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:55.376544 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c80a8-820a-420c-b575-c6cda4a582ac None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:55.376987 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c80a8-820a-420c-b575-c6cda4a582ac None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:55.377351 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c80a8-820a-420c-b575-c6cda4a582ac None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:55.378226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c80a8-820a-420c-b575-c6cda4a582ac None admin] RBAC: Adding query filter params (type=image) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:55.378705 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c80a8-820a-420c-b575-c6cda4a582ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:55.380306 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c80a8-820a-420c-b575-c6cda4a582ac None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:55.384953 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ad817-5885-44b0-9344-e0bfc2f9d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:55.385807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ad817-5885-44b0-9344-e0bfc2f9d909 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:55.386254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ad817-5885-44b0-9344-e0bfc2f9d909 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:55.386686 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ad817-5885-44b0-9344-e0bfc2f9d909 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:55.391443 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 362/722] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:55.392358 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c80a8-820a-420c-b575-c6cda4a582ac None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:55.395925 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ad817-5885-44b0-9344-e0bfc2f9d909 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:55.398209 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ad817-5885-44b0-9344-e0bfc2f9d909 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-473ad817-5885-44b0-9344-e0bfc2f9d909 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:27:55.415334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:55.424066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:55.425128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:55.425128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:55.425128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:27:55.425128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:27:55.425128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:27:55.425128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:27:55.425128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:27:55.425128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:27:55.425128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:27:55.425128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:55.425128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 361/723] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 19 17:27:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:55.425128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ad817-5885-44b0-9344-e0bfc2f9d909 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:55.440737 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:55.535623 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ad817-5885-44b0-9344-e0bfc2f9d909 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:55.541167 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c80a8-820a-420c-b575-c6cda4a582ac None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:55.575512 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b55e-826f-4c68-8bd1-951630a7a755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:55.576133 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b55e-826f-4c68-8bd1-951630a7a755 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:55.576469 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b55e-826f-4c68-8bd1-951630a7a755 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:55.576764 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0b55e-826f-4c68-8bd1-951630a7a755 None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:55.577733 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0b55e-826f-4c68-8bd1-951630a7a755 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:55.577852 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0b55e-826f-4c68-8bd1-951630a7a755 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:55.579574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0b55e-826f-4c68-8bd1-951630a7a755 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:55.591223 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46f757-886b-4c01-921b-4e6b279c12d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:55.592224 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46f757-886b-4c01-921b-4e6b279c12d9 None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:55.592758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46f757-886b-4c01-921b-4e6b279c12d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:55.593227 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46f757-886b-4c01-921b-4e6b279c12d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:55.594192 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46f757-886b-4c01-921b-4e6b279c12d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:55.595896 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46f757-886b-4c01-921b-4e6b279c12d9 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:55.610027 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 362/724] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 19 17:27:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:55.611728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b55e-826f-4c68-8bd1-951630a7a755 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:55.682236 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:55.719304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0b55e-826f-4c68-8bd1-951630a7a755 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:55.727427 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 363/725] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 19 17:27:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:27:55.738657 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1fadb-0362-474a-abee-a604f979cd98 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:55.738959 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1fadb-0362-474a-abee-a604f979cd98 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:55.742607 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1fadb-0362-474a-abee-a604f979cd98 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:55.742607 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 364/726] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:27:55.746874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b43d3-56c4-45eb-ba93-012b85332979 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:55.747459 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b43d3-56c4-45eb-ba93-012b85332979 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:55.747936 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b43d3-56c4-45eb-ba93-012b85332979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:55.756348 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:55.773832 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482b5dc-f793-4bf4-a28f-e56d3ed40d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:55.774465 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b5dc-f793-4bf4-a28f-e56d3ed40d1d None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:55.774788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b5dc-f793-4bf4-a28f-e56d3ed40d1d None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:55.775057 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b5dc-f793-4bf4-a28f-e56d3ed40d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:55.775399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-8d9b43d3-56c4-45eb-ba93-012b85332979 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:55.777093 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-8d9b43d3-56c4-45eb-ba93-012b85332979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:55.867002 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482b5dc-f793-4bf4-a28f-e56d3ed40d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:55.868982 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482b5dc-f793-4bf4-a28f-e56d3ed40d1d None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:55.877076 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 365/727] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:55 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:27:55.943756 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:55.990671 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 363/728] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:55 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 17:27:55.996639 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b43d3-56c4-45eb-ba93-012b85332979 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:56.101451 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b43d3-56c4-45eb-ba93-012b85332979 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:56.133635 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd7e13-3c02-48c1-8a5f-3298cd8be206 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:56.134051 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd7e13-3c02-48c1-8a5f-3298cd8be206 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:56.134175 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd7e13-3c02-48c1-8a5f-3298cd8be206 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:56.135708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 364/729] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:56.137100 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:56.140569 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9dc7e-edcd-49b9-b15d-ca446bf0722d None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:56.141008 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9dc7e-edcd-49b9-b15d-ca446bf0722d None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:56.141303 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9dc7e-edcd-49b9-b15d-ca446bf0722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:56.141822 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a5d4b-5478-427c-9132-36a08f13bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:56.142668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5d4b-5478-427c-9132-36a08f13bcd3 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:56.143158 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5d4b-5478-427c-9132-36a08f13bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:56.143623 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a5d4b-5478-427c-9132-36a08f13bcd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:56.155238 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a5d4b-5478-427c-9132-36a08f13bcd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:56.157014 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a5d4b-5478-427c-9132-36a08f13bcd3 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:56.159886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-96f9dc7e-edcd-49b9-b15d-ca446bf0722d None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:56.161203 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-96f9dc7e-edcd-49b9-b15d-ca446bf0722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-ef3a5d4b-5478-427c-9132-36a08f13bcd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:56.174309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:56.175338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:56.176304 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:56.176304 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:56.176304 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:56.182804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 366/730] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:56.184193 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a5d4b-5478-427c-9132-36a08f13bcd3 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:56.237699 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 365/731] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:56 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:27:56.238458 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9dc7e-edcd-49b9-b15d-ca446bf0722d None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:56.302298 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a5d4b-5478-427c-9132-36a08f13bcd3 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:56.330227 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:56.339801 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9dc7e-edcd-49b9-b15d-ca446bf0722d None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:56.344167 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f18d99-6843-4e92-bf27-f24a711c0e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:56.345371 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f18d99-6843-4e92-bf27-f24a711c0e85 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:56.347398 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f18d99-6843-4e92-bf27-f24a711c0e85 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:56.347398 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f18d99-6843-4e92-bf27-f24a711c0e85 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:56.347398 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f18d99-6843-4e92-bf27-f24a711c0e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:56.347398 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f18d99-6843-4e92-bf27-f24a711c0e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:56.348857 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f18d99-6843-4e92-bf27-f24a711c0e85 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:56.365119 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 367/732] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:56.373337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f18d99-6843-4e92-bf27-f24a711c0e85 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:56.380684 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bff0d7-a608-4f50-a5f9-fc3603b9d667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:56.381562 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bff0d7-a608-4f50-a5f9-fc3603b9d667 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:56.381980 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bff0d7-a608-4f50-a5f9-fc3603b9d667 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:56.382416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bff0d7-a608-4f50-a5f9-fc3603b9d667 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:56.383138 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bff0d7-a608-4f50-a5f9-fc3603b9d667 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:56.384843 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bff0d7-a608-4f50-a5f9-fc3603b9d667 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-21bff0d7-a608-4f50-a5f9-fc3603b9d667 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:56.393727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:56.394934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:27:56.395897 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:56.402938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 366/733] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Aug 19 17:27:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:56.403977 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bff0d7-a608-4f50-a5f9-fc3603b9d667 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:56.435714 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:56.491023 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f18d99-6843-4e92-bf27-f24a711c0e85 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:56.516326 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bff0d7-a608-4f50-a5f9-fc3603b9d667 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:56.526941 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edc54b-f596-4885-9b7a-d2a9eff3ae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:56.527761 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edc54b-f596-4885-9b7a-d2a9eff3ae65 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:56.528181 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edc54b-f596-4885-9b7a-d2a9eff3ae65 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:56.528617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edc54b-f596-4885-9b7a-d2a9eff3ae65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:56.535845 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edc54b-f596-4885-9b7a-d2a9eff3ae65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:56.537475 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edc54b-f596-4885-9b7a-d2a9eff3ae65 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-d3edc54b-f596-4885-9b7a-d2a9eff3ae65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:27:56.549137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:56.550256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:56.551194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:27:56.551194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:27:56.551194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:27:56.551194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:27:56.551194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:27:56.551194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:27:56.551194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:27:56.551194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:56.553487 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 368/734] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:56.559328 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edc54b-f596-4885-9b7a-d2a9eff3ae65 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:56.560593 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda62141-06ec-4345-b903-7aeaf7fe6a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:56.561544 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda62141-06ec-4345-b903-7aeaf7fe6a61 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:56.562035 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda62141-06ec-4345-b903-7aeaf7fe6a61 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:56.562680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda62141-06ec-4345-b903-7aeaf7fe6a61 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:56.564349 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda62141-06ec-4345-b903-7aeaf7fe6a61 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:56.564883 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda62141-06ec-4345-b903-7aeaf7fe6a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:56.566474 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda62141-06ec-4345-b903-7aeaf7fe6a61 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:56.577247 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 367/735] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 19 17:27:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:56.578324 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda62141-06ec-4345-b903-7aeaf7fe6a61 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:56.599985 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:56.673969 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edc54b-f596-4885-9b7a-d2a9eff3ae65 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:56.677466 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:56.678791 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda62141-06ec-4345-b903-7aeaf7fe6a61 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:56.711095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3651f-c012-4cbf-9fd6-a0daf3913d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:56.711935 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3651f-c012-4cbf-9fd6-a0daf3913d6d None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:56.712447 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3651f-c012-4cbf-9fd6-a0daf3913d6d None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:56.712938 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3651f-c012-4cbf-9fd6-a0daf3913d6d None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:56.713793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3651f-c012-4cbf-9fd6-a0daf3913d6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:56.713900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff5b24-9f09-4de4-aef8-f0999413c896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:56.714543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff5b24-9f09-4de4-aef8-f0999413c896 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:56.714702 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff5b24-9f09-4de4-aef8-f0999413c896 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:56.714959 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff5b24-9f09-4de4-aef8-f0999413c896 None admin] PATH_INFO: `/v3/services/network` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:56.715345 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3651f-c012-4cbf-9fd6-a0daf3913d6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:56.715518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff5b24-9f09-4de4-aef8-f0999413c896 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:56.716907 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff5b24-9f09-4de4-aef8-f0999413c896 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:56.717288 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3651f-c012-4cbf-9fd6-a0daf3913d6d None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-2cff5b24-9f09-4de4-aef8-f0999413c896 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:56.726412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:56.728757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:27:56.729613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 368/736] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:27:56 2022] GET /identity/v3/services/network => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:56.730408 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff5b24-9f09-4de4-aef8-f0999413c896 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:56.733394 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 369/737] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:27:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:27:56.734311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3651f-c012-4cbf-9fd6-a0daf3913d6d None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:56.824936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:56.840211 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff5b24-9f09-4de4-aef8-f0999413c896 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:56.847845 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3651f-c012-4cbf-9fd6-a0daf3913d6d None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:56.878749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6280b1-0e2f-40f6-a977-929c2bf58bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:56.879447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6280b1-0e2f-40f6-a977-929c2bf58bad None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:56.879725 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6280b1-0e2f-40f6-a977-929c2bf58bad None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:56.879987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6280b1-0e2f-40f6-a977-929c2bf58bad None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:56.880601 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6280b1-0e2f-40f6-a977-929c2bf58bad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:56.880938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6280b1-0e2f-40f6-a977-929c2bf58bad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:56.882497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6280b1-0e2f-40f6-a977-929c2bf58bad None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:56.888011 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 369/738] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 19 17:27:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:56.888820 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6280b1-0e2f-40f6-a977-929c2bf58bad None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:56.896892 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c2c79-6ecc-403e-8fce-c74b7c47f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:56.897300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c2c79-6ecc-403e-8fce-c74b7c47f882 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:56.897732 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c2c79-6ecc-403e-8fce-c74b7c47f882 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:56.898154 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c2c79-6ecc-403e-8fce-c74b7c47f882 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:56.899301 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c2c79-6ecc-403e-8fce-c74b7c47f882 None admin] RBAC: Adding query filter params (name=network) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:56.899812 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c2c79-6ecc-403e-8fce-c74b7c47f882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:56.901648 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c2c79-6ecc-403e-8fce-c74b7c47f882 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:56.908968 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 370/739] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:27:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:56.909249 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c2c79-6ecc-403e-8fce-c74b7c47f882 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:56.942462 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:57.009622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6280b1-0e2f-40f6-a977-929c2bf58bad None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:57.021922 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c2c79-6ecc-403e-8fce-c74b7c47f882 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:57.048000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f936f7-11db-456a-9008-5853270c6dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:57.049037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f936f7-11db-456a-9008-5853270c6dc6 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:57.049613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f936f7-11db-456a-9008-5853270c6dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:57.050075 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f936f7-11db-456a-9008-5853270c6dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:57.051002 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f936f7-11db-456a-9008-5853270c6dc6 None admin] RBAC: Adding query filter params (role.id=17791940429e48ac98d4bd49aa53a88c, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=fb1c954936f64051b09afba8df544ec7) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:57.051602 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f936f7-11db-456a-9008-5853270c6dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:57.053375 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f936f7-11db-456a-9008-5853270c6dc6 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:57.059952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e728ca-15f6-4b43-a02e-d96b5ed84b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:57.060541 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e728ca-15f6-4b43-a02e-d96b5ed84b45 None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:57.060932 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e728ca-15f6-4b43-a02e-d96b5ed84b45 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:57.061141 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 370/740] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:27:56 2022] GET /identity/v3/role_assignments?user.id=fb1c954936f64051b09afba8df544ec7&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=17791940429e48ac98d4bd49aa53a88c => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:57.061241 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e728ca-15f6-4b43-a02e-d96b5ed84b45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:57.062046 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e728ca-15f6-4b43-a02e-d96b5ed84b45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:57.062727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f936f7-11db-456a-9008-5853270c6dc6 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:57.063413 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e728ca-15f6-4b43-a02e-d96b5ed84b45 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:57.090439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:57.184938 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f936f7-11db-456a-9008-5853270c6dc6 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:57.197341 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 371/741] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 19 17:27:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:27:57.238125 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85235c6-3be2-4c7b-8680-8e6f621b0ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:57.239202 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85235c6-3be2-4c7b-8680-8e6f621b0ca0 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:57.239683 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85235c6-3be2-4c7b-8680-8e6f621b0ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:57.240163 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85235c6-3be2-4c7b-8680-8e6f621b0ca0 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:57.241077 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85235c6-3be2-4c7b-8680-8e6f621b0ca0 None admin] RBAC: Adding query filter params (type=network) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:57.241767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85235c6-3be2-4c7b-8680-8e6f621b0ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:57.243996 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85235c6-3be2-4c7b-8680-8e6f621b0ca0 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:57.250728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 371/742] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:27:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:57.257344 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e728ca-15f6-4b43-a02e-d96b5ed84b45 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:57.364465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:57.381436 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e728ca-15f6-4b43-a02e-d96b5ed84b45 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:57.423099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecba23-0b82-40a1-99ce-cd5a299f7d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:57.424202 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecba23-0b82-40a1-99ce-cd5a299f7d90 None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:57.424202 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecba23-0b82-40a1-99ce-cd5a299f7d90 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:57.424202 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecba23-0b82-40a1-99ce-cd5a299f7d90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:57.424953 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecba23-0b82-40a1-99ce-cd5a299f7d90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:57.426322 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecba23-0b82-40a1-99ce-cd5a299f7d90 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:57.552065 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 372/743] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 19 17:27:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:27:58.076687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218d933-03ed-4261-ac87-10ea40b150f2 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:58.077234 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218d933-03ed-4261-ac87-10ea40b150f2 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:58.077312 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218d933-03ed-4261-ac87-10ea40b150f2 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:58.078615 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 372/744] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:58.083744 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae422ab-cd55-471b-a1b9-15e15f0d271c None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:58.086674 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae422ab-cd55-471b-a1b9-15e15f0d271c None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:58.086674 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae422ab-cd55-471b-a1b9-15e15f0d271c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:58.102387 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-eae422ab-cd55-471b-a1b9-15e15f0d271c None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:58.103594 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-eae422ab-cd55-471b-a1b9-15e15f0d271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:58.178102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 373/745] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:58 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:27:58.505072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218d933-03ed-4261-ac87-10ea40b150f2 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:58.576281 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:58.605683 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218d933-03ed-4261-ac87-10ea40b150f2 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:58.639463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12664f-c599-4dac-9333-542679d06945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:58.640059 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12664f-c599-4dac-9333-542679d06945 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:58.640337 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12664f-c599-4dac-9333-542679d06945 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:58.640600 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12664f-c599-4dac-9333-542679d06945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:58.706971 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12664f-c599-4dac-9333-542679d06945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:58.708369 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12664f-c599-4dac-9333-542679d06945 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:58.777980 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:58.811925 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 373/746] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:27:58 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 17:27:58.815756 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae422ab-cd55-471b-a1b9-15e15f0d271c None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:58.883008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:58.917255 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae422ab-cd55-471b-a1b9-15e15f0d271c None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:58.952535 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05320161-4975-45c2-93f4-7a11501b305a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:58.953635 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05320161-4975-45c2-93f4-7a11501b305a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:58.953937 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05320161-4975-45c2-93f4-7a11501b305a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:58.954206 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05320161-4975-45c2-93f4-7a11501b305a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:58.965096 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05320161-4975-45c2-93f4-7a11501b305a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:58.966485 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05320161-4975-45c2-93f4-7a11501b305a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-05320161-4975-45c2-93f4-7a11501b305a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:27:58.986808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:58.987807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:27:58.988685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:27:58.988685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:27:58.988685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:58.988685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 374/747] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:27:58.994815 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12664f-c599-4dac-9333-542679d06945 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:59.098634 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12664f-c599-4dac-9333-542679d06945 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:59.137192 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10a47-08a3-4977-8080-b6f0c38c6e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:59.137801 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10a47-08a3-4977-8080-b6f0c38c6e2f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:59.138081 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10a47-08a3-4977-8080-b6f0c38c6e2f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:59.138351 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10a47-08a3-4977-8080-b6f0c38c6e2f None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:59.138989 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c10a47-08a3-4977-8080-b6f0c38c6e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:27:59.139292 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c10a47-08a3-4977-8080-b6f0c38c6e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:59.140702 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c10a47-08a3-4977-8080-b6f0c38c6e2f None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:59.152949 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 374/748] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:27:59.366574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426e96e-a4ea-41e2-82cc-9ed1a15bae95 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:59.366769 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426e96e-a4ea-41e2-82cc-9ed1a15bae95 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:59.367041 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426e96e-a4ea-41e2-82cc-9ed1a15bae95 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:59.368657 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 375/749] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:59.373832 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276900f0-650e-410c-87ea-5d82f14ec7f6 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:59.374136 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276900f0-650e-410c-87ea-5d82f14ec7f6 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:59.374390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276900f0-650e-410c-87ea-5d82f14ec7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:59.393354 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-276900f0-650e-410c-87ea-5d82f14ec7f6 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:59.394547 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-276900f0-650e-410c-87ea-5d82f14ec7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:59.428010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:59.472509 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 375/750] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:59 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:27:59.476502 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c15ed6-1e32-4298-9642-78196b221252 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:59.476857 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c15ed6-1e32-4298-9642-78196b221252 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:59.477201 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c15ed6-1e32-4298-9642-78196b221252 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:59.478510 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 376/751] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:27:59.483745 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326e41-0490-4032-a15a-d3fae723dd10 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:59.484034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326e41-0490-4032-a15a-d3fae723dd10 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:59.484309 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326e41-0490-4032-a15a-d3fae723dd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:59.502724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-15326e41-0490-4032-a15a-d3fae723dd10 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:27:59.503904 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-15326e41-0490-4032-a15a-d3fae723dd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:27:59.569510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 376/752] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:27:59 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:27:59.797177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c15ed6-1e32-4298-9642-78196b221252 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:59.890974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326e41-0490-4032-a15a-d3fae723dd10 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:59.899309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c15ed6-1e32-4298-9642-78196b221252 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:27:59.915827 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:59.932886 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e5ecc-bd6f-4c64-a8ee-c35d7949edb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:27:59.933505 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5ecc-bd6f-4c64-a8ee-c35d7949edb7 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:27:59.933788 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5ecc-bd6f-4c64-a8ee-c35d7949edb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:27:59.934057 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5ecc-bd6f-4c64-a8ee-c35d7949edb7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:27:59.934628 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e5ecc-bd6f-4c64-a8ee-c35d7949edb7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:27:59.935994 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e5ecc-bd6f-4c64-a8ee-c35d7949edb7 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-f03e5ecc-bd6f-4c64-a8ee-c35d7949edb7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:27:59.944681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:27:59.945659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:27:59.947194 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 377/753] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Aug 19 17:27:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:27:59.952762 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e5ecc-bd6f-4c64-a8ee-c35d7949edb7 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:27:59.984581 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:27:59.992743 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326e41-0490-4032-a15a-d3fae723dd10 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:00.025942 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7024e01-6f18-4838-9f69-0e36e3f7d912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:00.026554 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7024e01-6f18-4838-9f69-0e36e3f7d912 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:00.026823 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7024e01-6f18-4838-9f69-0e36e3f7d912 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:00.027090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7024e01-6f18-4838-9f69-0e36e3f7d912 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:00.027660 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7024e01-6f18-4838-9f69-0e36e3f7d912 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:00.029030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7024e01-6f18-4838-9f69-0e36e3f7d912 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-e7024e01-6f18-4838-9f69-0e36e3f7d912 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:28:00.037235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:28:00.038463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:00.039767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 377/754] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:27:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:28:00.044439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7024e01-6f18-4838-9f69-0e36e3f7d912 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:00.057044 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e5ecc-bd6f-4c64-a8ee-c35d7949edb7 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:00.092696 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e94a5-d2ad-4387-a8b3-c07ddee60803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:00.093319 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e94a5-d2ad-4387-a8b3-c07ddee60803 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:00.093596 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e94a5-d2ad-4387-a8b3-c07ddee60803 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:00.093865 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e94a5-d2ad-4387-a8b3-c07ddee60803 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:00.094478 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e94a5-d2ad-4387-a8b3-c07ddee60803 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:00.094805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e94a5-d2ad-4387-a8b3-c07ddee60803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:00.096173 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e94a5-d2ad-4387-a8b3-c07ddee60803 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:00.100701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 378/755] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 19 17:27:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:00.107609 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e94a5-d2ad-4387-a8b3-c07ddee60803 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:00.147052 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7024e01-6f18-4838-9f69-0e36e3f7d912 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:00.153713 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:00.180110 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d21542-8542-4db6-a26b-817cb45a26a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:00.180744 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d21542-8542-4db6-a26b-817cb45a26a4 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:00.181556 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d21542-8542-4db6-a26b-817cb45a26a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:00.181828 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d21542-8542-4db6-a26b-817cb45a26a4 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:00.182457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d21542-8542-4db6-a26b-817cb45a26a4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:00.182759 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d21542-8542-4db6-a26b-817cb45a26a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:00.184116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d21542-8542-4db6-a26b-817cb45a26a4 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:00.188675 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 378/756] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:28:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:00.194308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d21542-8542-4db6-a26b-817cb45a26a4 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:00.207438 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e94a5-d2ad-4387-a8b3-c07ddee60803 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:00.215356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:00.241699 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a21ec-b97b-4bea-86ef-5f94dbb110ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:00.242291 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a21ec-b97b-4bea-86ef-5f94dbb110ad None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:00.242571 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a21ec-b97b-4bea-86ef-5f94dbb110ad None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:00.242840 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a21ec-b97b-4bea-86ef-5f94dbb110ad None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:00.244017 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a21ec-b97b-4bea-86ef-5f94dbb110ad None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:00.244315 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a21ec-b97b-4bea-86ef-5f94dbb110ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:00.245764 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a21ec-b97b-4bea-86ef-5f94dbb110ad None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:00.250016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 379/757] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 19 17:28:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:00.295564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d21542-8542-4db6-a26b-817cb45a26a4 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:00.331227 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e21d2-3c69-4b2c-8091-be71e6a5948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:00.331750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e21d2-3c69-4b2c-8091-be71e6a5948a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:00.332023 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e21d2-3c69-4b2c-8091-be71e6a5948a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:00.332288 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e21d2-3c69-4b2c-8091-be71e6a5948a None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:00.332962 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e21d2-3c69-4b2c-8091-be71e6a5948a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:00.333251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e21d2-3c69-4b2c-8091-be71e6a5948a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:00.334614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e21d2-3c69-4b2c-8091-be71e6a5948a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:00.339540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 379/758] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:28:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:28:02.409296 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a11ce-de36-4559-a838-09c4f9c4aed0 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:02.409826 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a11ce-de36-4559-a838-09c4f9c4aed0 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:02.409826 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a11ce-de36-4559-a838-09c4f9c4aed0 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:02.411125 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 380/759] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:28:02.418714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529d5d6-30be-464e-8f5a-55ad06839ec5 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:02.419604 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529d5d6-30be-464e-8f5a-55ad06839ec5 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:02.419968 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529d5d6-30be-464e-8f5a-55ad06839ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:02.442058 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-3529d5d6-30be-464e-8f5a-55ad06839ec5 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:28:02.443225 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-3529d5d6-30be-464e-8f5a-55ad06839ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:28:02.507836 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 380/760] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:28:02 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:28:02.537403 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b67739-fc92-4afa-b47a-337662a4bf5c None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:02.537757 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b67739-fc92-4afa-b47a-337662a4bf5c None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:02.538040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b67739-fc92-4afa-b47a-337662a4bf5c None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:02.539351 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 381/761] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:28:02.545057 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999264f-a122-42e4-978e-72a1dda05659 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:02.545342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999264f-a122-42e4-978e-72a1dda05659 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:02.545613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999264f-a122-42e4-978e-72a1dda05659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:02.564324 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-5999264f-a122-42e4-978e-72a1dda05659 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:28:02.565534 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-5999264f-a122-42e4-978e-72a1dda05659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:28:02.574485 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:02.630118 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 381/762] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:28:02 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:28:02.830030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b67739-fc92-4afa-b47a-337662a4bf5c None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:02.927823 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b67739-fc92-4afa-b47a-337662a4bf5c None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:02.938059 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:02.954359 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999264f-a122-42e4-978e-72a1dda05659 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:02.960410 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40fda4-5c89-4d53-8137-4148b5489e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:02.961079 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40fda4-5c89-4d53-8137-4148b5489e6f None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:02.961361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40fda4-5c89-4d53-8137-4148b5489e6f None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:02.961633 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40fda4-5c89-4d53-8137-4148b5489e6f None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:02.962821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40fda4-5c89-4d53-8137-4148b5489e6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:02.964164 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40fda4-5c89-4d53-8137-4148b5489e6f None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:03.056665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999264f-a122-42e4-978e-72a1dda05659 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:03.090233 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d56c14-03d2-47b0-b334-cecec3c927a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:03.090774 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d56c14-03d2-47b0-b334-cecec3c927a7 None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:03.091052 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d56c14-03d2-47b0-b334-cecec3c927a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:03.091324 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d56c14-03d2-47b0-b334-cecec3c927a7 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:03.091950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d56c14-03d2-47b0-b334-cecec3c927a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:03.093338 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d56c14-03d2-47b0-b334-cecec3c927a7 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:03.333691 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 382/763] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 19 17:28:02 2022] POST /identity/v3/services => generated 269 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:28:03.368286 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 382/764] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 19 17:28:02 2022] POST /identity/v3/services => generated 251 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:28:05.565647 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c129a5d-abd5-4552-9428-d2f4adf737d9 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:05.568077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c129a5d-abd5-4552-9428-d2f4adf737d9 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:05.568077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c129a5d-abd5-4552-9428-d2f4adf737d9 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:05.568077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 383/765] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:28:05.572245 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be776734-4064-482e-8a23-78ecf345c381 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:05.572714 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf76e-c082-4893-bbba-f1c29ddfa841 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:05.572854 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be776734-4064-482e-8a23-78ecf345c381 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:05.572944 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf76e-c082-4893-bbba-f1c29ddfa841 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:05.573045 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be776734-4064-482e-8a23-78ecf345c381 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:05.573138 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf76e-c082-4893-bbba-f1c29ddfa841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:05.574119 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 383/766] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:28:05.579040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33e581-828a-443d-b2e2-2fd78e04b85c None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:05.579324 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33e581-828a-443d-b2e2-2fd78e04b85c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:05.579603 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33e581-828a-443d-b2e2-2fd78e04b85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:05.586457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:05.590781 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-15ecf76e-c082-4893-bbba-f1c29ddfa841 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:28:05.591954 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-15ecf76e-c082-4893-bbba-f1c29ddfa841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:28:05.596978 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-0b33e581-828a-443d-b2e2-2fd78e04b85c None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:28:05.598130 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-0b33e581-828a-443d-b2e2-2fd78e04b85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:28:05.666119 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 384/767] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:28:05 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:28:05.671329 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 384/768] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:28:05 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:28:05.988410 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf76e-c082-4893-bbba-f1c29ddfa841 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:05.993633 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33e581-828a-443d-b2e2-2fd78e04b85c None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:06.079417 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:06.085290 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf76e-c082-4893-bbba-f1c29ddfa841 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:06.091218 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33e581-828a-443d-b2e2-2fd78e04b85c None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:06.118337 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:06.118614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0c4d-34e7-4635-9629-6d6450e8450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:06.119235 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0c4d-34e7-4635-9629-6d6450e8450f None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:06.119509 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0c4d-34e7-4635-9629-6d6450e8450f None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:06.119784 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0c4d-34e7-4635-9629-6d6450e8450f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:06.120355 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0c4d-34e7-4635-9629-6d6450e8450f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:06.121735 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0c4d-34e7-4635-9629-6d6450e8450f None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:06.123549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed80853-afdd-429a-b1eb-e5b4b89e9741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:06.124162 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed80853-afdd-429a-b1eb-e5b4b89e9741 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:06.124438 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed80853-afdd-429a-b1eb-e5b4b89e9741 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:06.124706 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed80853-afdd-429a-b1eb-e5b4b89e9741 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:06.125299 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed80853-afdd-429a-b1eb-e5b4b89e9741 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:06.126636 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed80853-afdd-429a-b1eb-e5b4b89e9741 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-3b4a0c4d-34e7-4635-9629-6d6450e8450f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:28:06.130144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:28:06.131285 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:06.132550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 385/769] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Aug 19 17:28:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-5ed80853-afdd-429a-b1eb-e5b4b89e9741 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:28:06.137067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:28:06.139358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:28:06.140392 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:06.141181 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0c4d-34e7-4635-9629-6d6450e8450f None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:06.141263 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 385/770] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:28:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:28:06.143687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed80853-afdd-429a-b1eb-e5b4b89e9741 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:06.237511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0c4d-34e7-4635-9629-6d6450e8450f None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:06.239854 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed80853-afdd-429a-b1eb-e5b4b89e9741 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:06.270404 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e65a9-262b-40cb-b900-f257df1c248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:06.270998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e65a9-262b-40cb-b900-f257df1c248a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:06.271274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e65a9-262b-40cb-b900-f257df1c248a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:06.271544 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e65a9-262b-40cb-b900-f257df1c248a None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:06.272164 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e65a9-262b-40cb-b900-f257df1c248a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:06.272462 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e65a9-262b-40cb-b900-f257df1c248a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:06.273689 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a2d7d-3249-40e1-8b87-318addf1896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:06.274289 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a2d7d-3249-40e1-8b87-318addf1896a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:06.275124 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a2d7d-3249-40e1-8b87-318addf1896a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:06.275296 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e65a9-262b-40cb-b900-f257df1c248a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:06.275398 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a2d7d-3249-40e1-8b87-318addf1896a None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:06.275997 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a2d7d-3249-40e1-8b87-318addf1896a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:06.276348 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a2d7d-3249-40e1-8b87-318addf1896a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:06.277804 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a2d7d-3249-40e1-8b87-318addf1896a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:06.280040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 386/771] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 19 17:28:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:06.286188 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 386/772] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:28:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:06.286330 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e65a9-262b-40cb-b900-f257df1c248a None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:06.287603 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a2d7d-3249-40e1-8b87-318addf1896a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:06.311371 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:06.345397 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:06.387767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a2d7d-3249-40e1-8b87-318addf1896a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:06.427776 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a26c0-b795-4d70-af4a-5495a8fe3d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:06.428395 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a26c0-b795-4d70-af4a-5495a8fe3d43 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:06.428672 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a26c0-b795-4d70-af4a-5495a8fe3d43 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:06.428979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a26c0-b795-4d70-af4a-5495a8fe3d43 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:06.429613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a26c0-b795-4d70-af4a-5495a8fe3d43 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:06.429911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a26c0-b795-4d70-af4a-5495a8fe3d43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:06.431826 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a26c0-b795-4d70-af4a-5495a8fe3d43 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:06.437554 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 387/773] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:28:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:06.443642 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a26c0-b795-4d70-af4a-5495a8fe3d43 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:06.511059 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e65a9-262b-40cb-b900-f257df1c248a None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:06.543605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63104658-01f0-477f-b821-4e593350bced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:06.544192 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63104658-01f0-477f-b821-4e593350bced None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:06.544463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63104658-01f0-477f-b821-4e593350bced None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:06.544764 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63104658-01f0-477f-b821-4e593350bced None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:06.545369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63104658-01f0-477f-b821-4e593350bced None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:06.545664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63104658-01f0-477f-b821-4e593350bced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:06.546706 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a26c0-b795-4d70-af4a-5495a8fe3d43 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:06.547277 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63104658-01f0-477f-b821-4e593350bced None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:06.552033 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 387/774] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 19 17:28:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:28:06.558596 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63104658-01f0-477f-b821-4e593350bced None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:06.569458 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:06.581495 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783940e-2ed0-4eb2-9dca-0262f25d6ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:06.585128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783940e-2ed0-4eb2-9dca-0262f25d6ebe None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:06.585128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783940e-2ed0-4eb2-9dca-0262f25d6ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:06.585128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783940e-2ed0-4eb2-9dca-0262f25d6ebe None admin] PATH_INFO: `/v3/endpoints` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:06.585128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783940e-2ed0-4eb2-9dca-0262f25d6ebe None admin] RBAC: Adding query filter params (interface=public, service_id=0651bf2f2e7e4c2093a78a1a01587493, region_id=RegionOne) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:06.585128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783940e-2ed0-4eb2-9dca-0262f25d6ebe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:06.585128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783940e-2ed0-4eb2-9dca-0262f25d6ebe None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:06.590018 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 388/775] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 19 17:28:06 2022] GET /identity/v3/endpoints?service_id=0651bf2f2e7e4c2093a78a1a01587493&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:06.595406 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783940e-2ed0-4eb2-9dca-0262f25d6ebe None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:06.645474 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:06.656819 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63104658-01f0-477f-b821-4e593350bced None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:06.691179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7370ce7-d7c0-412e-b90d-e1196a23c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:06.691764 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7370ce7-d7c0-412e-b90d-e1196a23c232 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:06.692039 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7370ce7-d7c0-412e-b90d-e1196a23c232 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:06.692308 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7370ce7-d7c0-412e-b90d-e1196a23c232 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:06.693019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7370ce7-d7c0-412e-b90d-e1196a23c232 None admin] RBAC: Adding query filter params (interface=public, service_id=a3fbc2596bb4479aa9ce8883994c3b44, region_id=RegionOne) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:06.693133 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783940e-2ed0-4eb2-9dca-0262f25d6ebe None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:06.693324 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7370ce7-d7c0-412e-b90d-e1196a23c232 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:06.694666 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7370ce7-d7c0-412e-b90d-e1196a23c232 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:06.700024 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 388/776] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 19 17:28:06 2022] GET /identity/v3/endpoints?service_id=a3fbc2596bb4479aa9ce8883994c3b44&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:06.705447 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7370ce7-d7c0-412e-b90d-e1196a23c232 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:06.726106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f2059-d620-4870-8280-1ff5d95f0823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:06.726699 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f2059-d620-4870-8280-1ff5d95f0823 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:06.726976 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f2059-d620-4870-8280-1ff5d95f0823 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:06.727245 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f2059-d620-4870-8280-1ff5d95f0823 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:06.727862 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f2059-d620-4870-8280-1ff5d95f0823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:06.729253 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f2059-d620-4870-8280-1ff5d95f0823 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:06.735458 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 389/777] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 19 17:28:06 2022] GET /identity/v3/services => generated 1498 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 17:28:06.813811 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7370ce7-d7c0-412e-b90d-e1196a23c232 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:06.849491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54249128-7c99-448a-a1e7-b3bc3ec1f3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:06.850101 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249128-7c99-448a-a1e7-b3bc3ec1f3e2 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:06.850375 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249128-7c99-448a-a1e7-b3bc3ec1f3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:06.850643 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249128-7c99-448a-a1e7-b3bc3ec1f3e2 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:06.851246 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54249128-7c99-448a-a1e7-b3bc3ec1f3e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:06.853180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54249128-7c99-448a-a1e7-b3bc3ec1f3e2 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:06.859849 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 389/778] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 19 17:28:06 2022] GET /identity/v3/services => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 17:28:08.939790 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3bc52-3c5d-43ad-abdf-0193a0d348ee None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:08.940334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3bc52-3c5d-43ad-abdf-0193a0d348ee None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:08.940334 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3bc52-3c5d-43ad-abdf-0193a0d348ee None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:08.941685 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 390/779] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:28:08.947440 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2450f7-adb0-4887-a5f3-6023e054d45e None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:08.947820 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2450f7-adb0-4887-a5f3-6023e054d45e None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:08.948004 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2450f7-adb0-4887-a5f3-6023e054d45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:08.965403 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-5a2450f7-adb0-4887-a5f3-6023e054d45e None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:28:08.966571 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-5a2450f7-adb0-4887-a5f3-6023e054d45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:28:08.976951 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:09.030628 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f2831-1f7b-4667-b194-0aff89b22e4b None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:09.030911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f2831-1f7b-4667-b194-0aff89b22e4b None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:09.031192 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f2831-1f7b-4667-b194-0aff89b22e4b None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:09.031320 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 390/780] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:28:08 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:28:09.032625 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 391/781] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:28:09.037767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d1456-d919-4eb3-b9fe-6e72433edc69 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:09.038053 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d1456-d919-4eb3-b9fe-6e72433edc69 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:09.038327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d1456-d919-4eb3-b9fe-6e72433edc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:09.056061 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-ee7d1456-d919-4eb3-b9fe-6e72433edc69 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:28:09.057292 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-ee7d1456-d919-4eb3-b9fe-6e72433edc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:28:09.121612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 391/782] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:28:09 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:28:09.359872 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f2831-1f7b-4667-b194-0aff89b22e4b None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:09.409230 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:09.441536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d1456-d919-4eb3-b9fe-6e72433edc69 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:09.463970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f2831-1f7b-4667-b194-0aff89b22e4b None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:09.496707 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8968d-482f-4da0-adcd-158f65b06ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:09.497348 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8968d-482f-4da0-adcd-158f65b06ce3 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:09.498028 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8968d-482f-4da0-adcd-158f65b06ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:09.498028 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8968d-482f-4da0-adcd-158f65b06ce3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:09.498441 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8968d-482f-4da0-adcd-158f65b06ce3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:09.499791 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8968d-482f-4da0-adcd-158f65b06ce3 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-e7b8968d-482f-4da0-adcd-158f65b06ce3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:28:09.508135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:28:09.509417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:09.510728 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 392/783] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:28:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:28:09.515043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8968d-482f-4da0-adcd-158f65b06ce3 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:09.521160 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:09.544554 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d1456-d919-4eb3-b9fe-6e72433edc69 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:09.578905 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdf3d9-0de4-4075-9abd-d3cdace05c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:09.579525 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdf3d9-0de4-4075-9abd-d3cdace05c52 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:09.579802 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdf3d9-0de4-4075-9abd-d3cdace05c52 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:09.580510 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdf3d9-0de4-4075-9abd-d3cdace05c52 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:09.580707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdf3d9-0de4-4075-9abd-d3cdace05c52 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:09.582127 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdf3d9-0de4-4075-9abd-d3cdace05c52 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-f6bdf3d9-0de4-4075-9abd-d3cdace05c52 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:28:09.591327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:28:09.592465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:09.593659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 392/784] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Aug 19 17:28:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:28:09.598339 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdf3d9-0de4-4075-9abd-d3cdace05c52 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:09.616950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8968d-482f-4da0-adcd-158f65b06ce3 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:09.635234 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:09.661354 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34afc76-3e17-456e-9ae3-2133779c106f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:09.661962 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34afc76-3e17-456e-9ae3-2133779c106f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:09.662240 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34afc76-3e17-456e-9ae3-2133779c106f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:09.662512 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34afc76-3e17-456e-9ae3-2133779c106f None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:09.663142 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34afc76-3e17-456e-9ae3-2133779c106f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:09.663434 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34afc76-3e17-456e-9ae3-2133779c106f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:09.664820 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34afc76-3e17-456e-9ae3-2133779c106f None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:09.670809 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 393/785] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:28:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:09.676646 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34afc76-3e17-456e-9ae3-2133779c106f None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:09.703422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdf3d9-0de4-4075-9abd-d3cdace05c52 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:09.736962 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dfa73-e6f5-49f0-b04b-ccc6078ade49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:09.737554 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dfa73-e6f5-49f0-b04b-ccc6078ade49 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:09.737829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dfa73-e6f5-49f0-b04b-ccc6078ade49 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:09.738100 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dfa73-e6f5-49f0-b04b-ccc6078ade49 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:09.738716 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dfa73-e6f5-49f0-b04b-ccc6078ade49 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:09.739015 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dfa73-e6f5-49f0-b04b-ccc6078ade49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:09.740383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dfa73-e6f5-49f0-b04b-ccc6078ade49 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:09.744964 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 393/786] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 19 17:28:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:09.750495 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dfa73-e6f5-49f0-b04b-ccc6078ade49 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:09.753800 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:09.772385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34afc76-3e17-456e-9ae3-2133779c106f None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:09.806425 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa8b02-d6eb-44bc-89ef-ed45b5260eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:09.807108 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa8b02-d6eb-44bc-89ef-ed45b5260eb4 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:09.807450 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa8b02-d6eb-44bc-89ef-ed45b5260eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:09.807725 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa8b02-d6eb-44bc-89ef-ed45b5260eb4 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:09.808340 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa8b02-d6eb-44bc-89ef-ed45b5260eb4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:09.808641 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa8b02-d6eb-44bc-89ef-ed45b5260eb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:09.810026 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa8b02-d6eb-44bc-89ef-ed45b5260eb4 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:09.814570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 394/787] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 19 17:28:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:09.820231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa8b02-d6eb-44bc-89ef-ed45b5260eb4 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:09.848262 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dfa73-e6f5-49f0-b04b-ccc6078ade49 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:09.862200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:09.880930 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce900f-d92b-48c5-82cc-cc0ef3f6f4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:09.881473 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce900f-d92b-48c5-82cc-cc0ef3f6f4ca None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:09.881738 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce900f-d92b-48c5-82cc-cc0ef3f6f4ca None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:09.882006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce900f-d92b-48c5-82cc-cc0ef3f6f4ca None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:09.882621 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce900f-d92b-48c5-82cc-cc0ef3f6f4ca None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:09.882919 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce900f-d92b-48c5-82cc-cc0ef3f6f4ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:09.884791 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce900f-d92b-48c5-82cc-cc0ef3f6f4ca None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:09.889482 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 394/788] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 19 17:28:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:09.895533 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce900f-d92b-48c5-82cc-cc0ef3f6f4ca None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:09.917822 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa8b02-d6eb-44bc-89ef-ed45b5260eb4 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:09.958158 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7ebde-85d8-4b62-84cd-67d2ed133e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:09.959376 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:09.959800 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7ebde-85d8-4b62-84cd-67d2ed133e4c None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:09.959800 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7ebde-85d8-4b62-84cd-67d2ed133e4c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:09.960019 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7ebde-85d8-4b62-84cd-67d2ed133e4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:09.960639 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7ebde-85d8-4b62-84cd-67d2ed133e4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:09.962630 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7ebde-85d8-4b62-84cd-67d2ed133e4c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:09.992169 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce900f-d92b-48c5-82cc-cc0ef3f6f4ca None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:10.025476 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25ab27-e45d-485a-90a2-6cde18b98fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:10.026061 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25ab27-e45d-485a-90a2-6cde18b98fb9 None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:10.026341 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25ab27-e45d-485a-90a2-6cde18b98fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:10.026609 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25ab27-e45d-485a-90a2-6cde18b98fb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:10.027245 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25ab27-e45d-485a-90a2-6cde18b98fb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:10.028584 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25ab27-e45d-485a-90a2-6cde18b98fb9 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:10.055327 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 395/789] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 19 17:28:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:28:10.140687 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 395/790] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 19 17:28:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:28:12.270813 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c59bf-9b6c-4717-a2fb-950e0b376014 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:12.271378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c59bf-9b6c-4717-a2fb-950e0b376014 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:12.271378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c59bf-9b6c-4717-a2fb-950e0b376014 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:12.272652 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 396/791] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:28:12.278354 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bc805-1c29-460e-b4a8-6c8624cecdcc None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:12.278737 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bc805-1c29-460e-b4a8-6c8624cecdcc None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:12.279029 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bc805-1c29-460e-b4a8-6c8624cecdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:12.296826 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-087bc805-1c29-460e-b4a8-6c8624cecdcc None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:28:12.298268 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-087bc805-1c29-460e-b4a8-6c8624cecdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:28:12.324700 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d3871-000e-463f-9016-5d234c7b3786 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:12.325010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d3871-000e-463f-9016-5d234c7b3786 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:12.325287 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d3871-000e-463f-9016-5d234c7b3786 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:12.326710 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 397/792] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:28:12.331296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954ce8a-13ac-4cd0-b6a4-5fb6021e8465 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:12.331582 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954ce8a-13ac-4cd0-b6a4-5fb6021e8465 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:12.331862 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954ce8a-13ac-4cd0-b6a4-5fb6021e8465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:12.349565 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-a954ce8a-13ac-4cd0-b6a4-5fb6021e8465 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:28:12.350731 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-a954ce8a-13ac-4cd0-b6a4-5fb6021e8465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:28:12.371488 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 396/793] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:28:12 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:28:12.418331 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 398/794] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:28:12 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:28:12.708460 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bc805-1c29-460e-b4a8-6c8624cecdcc None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:12.744294 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954ce8a-13ac-4cd0-b6a4-5fb6021e8465 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:12.756484 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:12.771998 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:12.804728 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bc805-1c29-460e-b4a8-6c8624cecdcc None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:12.838789 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c17643-a37e-42c1-9e8b-4713b09c3581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:12.839396 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17643-a37e-42c1-9e8b-4713b09c3581 None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:12.839671 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17643-a37e-42c1-9e8b-4713b09c3581 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:12.839941 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17643-a37e-42c1-9e8b-4713b09c3581 None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:12.840574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c17643-a37e-42c1-9e8b-4713b09c3581 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:12.841600 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954ce8a-13ac-4cd0-b6a4-5fb6021e8465 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:12.842030 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c17643-a37e-42c1-9e8b-4713b09c3581 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:12.844619 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: WARNING keystone.server.flask.common [None req-86c17643-a37e-42c1-9e8b-4713b09c3581 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 17:28:12.875761 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89218c-9e69-43a9-b51e-797971142259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:12.876375 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89218c-9e69-43a9-b51e-797971142259 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:12.876649 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89218c-9e69-43a9-b51e-797971142259 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:12.876946 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89218c-9e69-43a9-b51e-797971142259 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:12.877516 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89218c-9e69-43a9-b51e-797971142259 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:12.878870 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89218c-9e69-43a9-b51e-797971142259 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-3a89218c-9e69-43a9-b51e-797971142259 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:28:12.887190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:28:12.888361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:12.889336 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 399/795] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:28:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:28:12.892946 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.sql.core [None req-86c17643-a37e-42c1-9e8b-4713b09c3581 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 17:28:12.892946 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 17:28:12.892946 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [parameters: {'id': '4092f1504e744f678a55279dba192575', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 17:28:12.892946 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88636) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 17:28:12.893965 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89218c-9e69-43a9-b51e-797971142259 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-86c17643-a37e-42c1-9e8b-4713b09c3581 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4092f1504e744f678a55279dba192575.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4092f1504e744f678a55279dba192575. Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application conn.query(q) Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 17:28:12.909422 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application result.read() Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 17:28:12.910311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application next(self.gen) Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application yield resource Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application next(self.gen) Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise self.value Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application session.commit() Aug 19 17:28:12.911522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self.session.flush() Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application compat.raise_( Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 17:28:12.912664 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 17:28:12.913669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application conn.query(q) Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application result.read() Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 17:28:12.914498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [parameters: {'id': '4092f1504e744f678a55279dba192575', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:12.916940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:28:12.918021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:28:12.919208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:28:12.919208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 17:28:12.919208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 17:28:12.919208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:28:12.919208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:28:12.919208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 17:28:12.919208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 17:28:12.919208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4092f1504e744f678a55279dba192575. Aug 19 17:28:12.919208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:12.919208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 397/796] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Aug 19 17:28:12 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:28:12.919208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c17643-a37e-42c1-9e8b-4713b09c3581 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:12.983325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:12.991586 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89218c-9e69-43a9-b51e-797971142259 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:13.021494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c17643-a37e-42c1-9e8b-4713b09c3581 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:13.027233 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439fb62-d01f-487b-8f91-27ceac1dbb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:13.027833 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439fb62-d01f-487b-8f91-27ceac1dbb7c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:13.028138 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439fb62-d01f-487b-8f91-27ceac1dbb7c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:13.028409 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439fb62-d01f-487b-8f91-27ceac1dbb7c None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:13.029129 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439fb62-d01f-487b-8f91-27ceac1dbb7c None admin] RBAC: Adding query filter params (name=compute) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:13.029430 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439fb62-d01f-487b-8f91-27ceac1dbb7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:13.030800 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439fb62-d01f-487b-8f91-27ceac1dbb7c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:13.031676 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:13.035750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 400/797] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:28:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:13.041851 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439fb62-d01f-487b-8f91-27ceac1dbb7c None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:13.059109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ce878-5eb0-4baa-8db7-395684d6a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:13.059736 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ce878-5eb0-4baa-8db7-395684d6a466 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:13.060013 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ce878-5eb0-4baa-8db7-395684d6a466 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:13.060283 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ce878-5eb0-4baa-8db7-395684d6a466 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:13.066703 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ce878-5eb0-4baa-8db7-395684d6a466 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:13.068323 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ce878-5eb0-4baa-8db7-395684d6a466 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-b68ce878-5eb0-4baa-8db7-395684d6a466 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:28:13.079612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:28:13.082638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:28:13.083758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:28:13.083758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:28:13.083758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:28:13.083758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:28:13.083758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:28:13.083758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:28:13.083758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:28:13.083758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:13.083758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 398/798] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:28:13.086356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ce878-5eb0-4baa-8db7-395684d6a466 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:13.143814 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439fb62-d01f-487b-8f91-27ceac1dbb7c None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:13.177190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f277c8-4bb1-4af5-a25a-52f0ef34fcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:13.177786 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f277c8-4bb1-4af5-a25a-52f0ef34fcfb None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:13.178066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f277c8-4bb1-4af5-a25a-52f0ef34fcfb None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:13.178339 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f277c8-4bb1-4af5-a25a-52f0ef34fcfb None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:13.178952 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f277c8-4bb1-4af5-a25a-52f0ef34fcfb None admin] RBAC: Adding query filter params (type=compute) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:13.179248 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f277c8-4bb1-4af5-a25a-52f0ef34fcfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:13.181177 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f277c8-4bb1-4af5-a25a-52f0ef34fcfb None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:13.185372 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 401/799] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:28:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:13.188893 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ce878-5eb0-4baa-8db7-395684d6a466 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:13.225762 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e28f30-326e-45e6-bd3f-8e716f7fb000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:13.226371 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e28f30-326e-45e6-bd3f-8e716f7fb000 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:13.226647 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e28f30-326e-45e6-bd3f-8e716f7fb000 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:13.226911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e28f30-326e-45e6-bd3f-8e716f7fb000 None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:13.228143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e28f30-326e-45e6-bd3f-8e716f7fb000 None admin] RBAC: Adding query filter params (name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:13.228439 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e28f30-326e-45e6-bd3f-8e716f7fb000 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:13.229921 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e28f30-326e-45e6-bd3f-8e716f7fb000 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:13.251822 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 399/800] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:28:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:28:15.370521 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52a04-0605-4f52-8c26-c0e4214d66ac None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:15.371084 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52a04-0605-4f52-8c26-c0e4214d66ac None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:15.371084 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52a04-0605-4f52-8c26-c0e4214d66ac None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:15.372344 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 402/801] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:28:15.377669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf35f5-3168-4219-a3af-bc8138973adb None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:15.378072 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf35f5-3168-4219-a3af-bc8138973adb None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:15.378336 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf35f5-3168-4219-a3af-bc8138973adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:15.396394 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-1cbf35f5-3168-4219-a3af-bc8138973adb None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:28:15.397949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-1cbf35f5-3168-4219-a3af-bc8138973adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:28:15.422827 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:15.469519 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 400/802] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:28:15 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:28:15.470289 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250ff33-e4b3-4fdf-88d2-ed61ada452f1 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:15.470580 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250ff33-e4b3-4fdf-88d2-ed61ada452f1 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:15.470903 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250ff33-e4b3-4fdf-88d2-ed61ada452f1 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:15.472200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 403/803] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:28:15.477299 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682bea-39dd-40c3-aeac-beefac477a8a None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:15.478136 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682bea-39dd-40c3-aeac-beefac477a8a None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:15.478413 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682bea-39dd-40c3-aeac-beefac477a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:15.495475 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-88682bea-39dd-40c3-aeac-beefac477a8a None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:28:15.496652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-88682bea-39dd-40c3-aeac-beefac477a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:28:15.560922 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 401/804] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:28:15 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:28:15.800079 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250ff33-e4b3-4fdf-88d2-ed61ada452f1 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:15.822366 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:15.891749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88682bea-39dd-40c3-aeac-beefac477a8a None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:15.899504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250ff33-e4b3-4fdf-88d2-ed61ada452f1 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:15.934372 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4315c-7758-4dd9-8a5c-afd4304ca105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:15.934993 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4315c-7758-4dd9-8a5c-afd4304ca105 None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:15.935269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4315c-7758-4dd9-8a5c-afd4304ca105 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:15.935542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4315c-7758-4dd9-8a5c-afd4304ca105 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:15.936171 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4315c-7758-4dd9-8a5c-afd4304ca105 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:15.937564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4315c-7758-4dd9-8a5c-afd4304ca105 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:15.974406 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:15.989134 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88682bea-39dd-40c3-aeac-beefac477a8a None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:16.004037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 404/805] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 19 17:28:15 2022] POST /identity/v3/services => generated 242 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:28:16.032091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50b84b-d612-4222-b43e-1f43b8f4499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:16.032702 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50b84b-d612-4222-b43e-1f43b8f4499e None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:16.033005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50b84b-d612-4222-b43e-1f43b8f4499e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:16.033270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50b84b-d612-4222-b43e-1f43b8f4499e None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:16.033901 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50b84b-d612-4222-b43e-1f43b8f4499e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:16.035353 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50b84b-d612-4222-b43e-1f43b8f4499e None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:16.084405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.sql.core [None req-4c50b84b-d612-4222-b43e-1f43b8f4499e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 17:28:16.084405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 17:28:16.084405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [parameters: {'user_id': '20edaf2e55a044fba9a62654b849f941', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 17:28:16.084405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88636) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-4c50b84b-d612-4222-b43e-1f43b8f4499e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application conn.query(q) Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application result.read() Aug 19 17:28:16.090899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 17:28:16.091787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application next(self.gen) Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application yield resource Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application next(self.gen) Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise self.value Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application session.commit() Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 17:28:16.092852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self.session.flush() Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application compat.raise_( Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 17:28:16.093749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 17:28:16.095109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application conn.query(q) Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application result.read() Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 17:28:16.096139 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [parameters: {'user_id': '20edaf2e55a044fba9a62654b849f941', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:28:16.097786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 17:28:16.099471 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 17:28:16.100691 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 17:28:16.100691 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 17:28:16.100691 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 17:28:16.100691 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 17:28:16.100691 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 17:28:16.100691 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:16.100691 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 402/806] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 19 17:28:15 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:28:16.101252 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4315c-7758-4dd9-8a5c-afd4304ca105 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:16.183228 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:16.203047 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4315c-7758-4dd9-8a5c-afd4304ca105 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:16.237661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90434fd3-9a72-43aa-8c9a-0d3296d50345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:16.238278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90434fd3-9a72-43aa-8c9a-0d3296d50345 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:16.238550 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90434fd3-9a72-43aa-8c9a-0d3296d50345 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:16.238818 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90434fd3-9a72-43aa-8c9a-0d3296d50345 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:16.245818 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90434fd3-9a72-43aa-8c9a-0d3296d50345 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:16.247293 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90434fd3-9a72-43aa-8c9a-0d3296d50345 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-90434fd3-9a72-43aa-8c9a-0d3296d50345 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:28:16.259114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:28:16.260237 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:28:16.261356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:28:16.261356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:28:16.261356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:28:16.261356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:28:16.261356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:28:16.261356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:28:16.261356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:28:16.261356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:28:16.261356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:28:16.261356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:16.261356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 405/807] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:28:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:28:16.266206 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50b84b-d612-4222-b43e-1f43b8f4499e None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:16.380290 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50b84b-d612-4222-b43e-1f43b8f4499e None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:16.413756 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d5722-135d-42ee-a211-f65584f33c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:16.414346 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d5722-135d-42ee-a211-f65584f33c4b None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:16.414624 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d5722-135d-42ee-a211-f65584f33c4b None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:16.415871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d5722-135d-42ee-a211-f65584f33c4b None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:16.416259 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d5722-135d-42ee-a211-f65584f33c4b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:16.416532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d5722-135d-42ee-a211-f65584f33c4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:16.418211 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d5722-135d-42ee-a211-f65584f33c4b None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:16.457788 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 403/808] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 19 17:28:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:28:18.184407 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa8378-5265-483f-985a-323b0f5d5a1a None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:18.184973 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa8378-5265-483f-985a-323b0f5d5a1a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:18.184973 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa8378-5265-483f-985a-323b0f5d5a1a None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:18.186282 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 406/809] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:28:18.191405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678029ca-ff54-4122-b345-9bd93a43c266 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:18.191842 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678029ca-ff54-4122-b345-9bd93a43c266 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:18.191959 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678029ca-ff54-4122-b345-9bd93a43c266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:18.198904 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:18.210899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-678029ca-ff54-4122-b345-9bd93a43c266 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:28:18.213036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-678029ca-ff54-4122-b345-9bd93a43c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:28:18.277903 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 404/810] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:28:18 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:28:18.599260 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa8378-5265-483f-985a-323b0f5d5a1a None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:18.697152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa8378-5265-483f-985a-323b0f5d5a1a None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:18.728462 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e8cfd-7142-4086-9723-539fbe296f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:18.729097 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e8cfd-7142-4086-9723-539fbe296f71 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:18.729374 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e8cfd-7142-4086-9723-539fbe296f71 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:18.729640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e8cfd-7142-4086-9723-539fbe296f71 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:18.730201 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e8cfd-7142-4086-9723-539fbe296f71 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:18.731560 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e8cfd-7142-4086-9723-539fbe296f71 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-df0e8cfd-7142-4086-9723-539fbe296f71 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:28:18.739830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:28:18.741000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:28:18.742231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 407/811] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:28:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:28:18.747269 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678029ca-ff54-4122-b345-9bd93a43c266 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:18.840971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678029ca-ff54-4122-b345-9bd93a43c266 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:18.871350 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:18.875949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61a85d-e658-4a4a-a296-ab646394fe28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:18.876528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61a85d-e658-4a4a-a296-ab646394fe28 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:18.876831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61a85d-e658-4a4a-a296-ab646394fe28 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:18.877099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61a85d-e658-4a4a-a296-ab646394fe28 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:18.877709 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61a85d-e658-4a4a-a296-ab646394fe28 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:18.878005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61a85d-e658-4a4a-a296-ab646394fe28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:18.879401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61a85d-e658-4a4a-a296-ab646394fe28 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:18.884039 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 405/812] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:28:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:28:18.889831 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e8cfd-7142-4086-9723-539fbe296f71 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:18.894106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:18.985773 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e8cfd-7142-4086-9723-539fbe296f71 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:19.017676 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f960ad-4850-4f57-bebb-4d18574b4f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:19.018256 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f960ad-4850-4f57-bebb-4d18574b4f9b None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:19.018529 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f960ad-4850-4f57-bebb-4d18574b4f9b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:19.018794 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f960ad-4850-4f57-bebb-4d18574b4f9b None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:19.019398 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f960ad-4850-4f57-bebb-4d18574b4f9b None admin] RBAC: Adding query filter params (type=compute) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:19.019691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f960ad-4850-4f57-bebb-4d18574b4f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:19.021061 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f960ad-4850-4f57-bebb-4d18574b4f9b None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:19.025602 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 408/813] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:28:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:28:19.031583 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61a85d-e658-4a4a-a296-ab646394fe28 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:19.126428 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61a85d-e658-4a4a-a296-ab646394fe28 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:19.157766 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70395475-5d88-4b4a-bc13-f5aa5fb02914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:19.158337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70395475-5d88-4b4a-bc13-f5aa5fb02914 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:19.158610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70395475-5d88-4b4a-bc13-f5aa5fb02914 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:19.158875 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70395475-5d88-4b4a-bc13-f5aa5fb02914 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:19.159556 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70395475-5d88-4b4a-bc13-f5aa5fb02914 None admin] RBAC: Adding query filter params (interface=public, service_id=69aab658e4a148f28c5914239046964c, region_id=RegionOne) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:19.159855 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70395475-5d88-4b4a-bc13-f5aa5fb02914 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:19.161221 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70395475-5d88-4b4a-bc13-f5aa5fb02914 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:19.166445 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 406/814] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 19 17:28:19 2022] GET /identity/v3/endpoints?service_id=69aab658e4a148f28c5914239046964c&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:28:19.171806 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f960ad-4850-4f57-bebb-4d18574b4f9b None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:19.236308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:19.267300 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f960ad-4850-4f57-bebb-4d18574b4f9b None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:19.300903 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57a072-6e45-4950-9903-7fbb1d11a737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:19.301488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57a072-6e45-4950-9903-7fbb1d11a737 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:19.301766 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57a072-6e45-4950-9903-7fbb1d11a737 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:19.302034 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57a072-6e45-4950-9903-7fbb1d11a737 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:19.302622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57a072-6e45-4950-9903-7fbb1d11a737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:19.303972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57a072-6e45-4950-9903-7fbb1d11a737 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:19.310047 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 409/815] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 19 17:28:19 2022] GET /identity/v3/services => generated 1728 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:28:21.492463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1bfe4-aee7-4de7-bb90-37644d80a1a5 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:21.493458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1bfe4-aee7-4de7-bb90-37644d80a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:21.493550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1bfe4-aee7-4de7-bb90-37644d80a1a5 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:21.494925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 407/816] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:28:21.500044 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf0b3f-1611-45bc-89e7-05a40f040653 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:21.500474 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf0b3f-1611-45bc-89e7-05a40f040653 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:21.500566 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf0b3f-1611-45bc-89e7-05a40f040653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:21.519103 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-fdbf0b3f-1611-45bc-89e7-05a40f040653 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:28:21.520257 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-fdbf0b3f-1611-45bc-89e7-05a40f040653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:28:21.583834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 410/817] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:28:21 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:28:21.908460 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1bfe4-aee7-4de7-bb90-37644d80a1a5 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:21.966704 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:22.006890 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1bfe4-aee7-4de7-bb90-37644d80a1a5 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:22.043383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025cb3a-5c51-4945-a7c7-5f050a856e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:22.043985 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025cb3a-5c51-4945-a7c7-5f050a856e3f None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:22.044267 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025cb3a-5c51-4945-a7c7-5f050a856e3f None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:22.044529 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025cb3a-5c51-4945-a7c7-5f050a856e3f None admin] PATH_INFO: `/v3/services/compute` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:22.045129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025cb3a-5c51-4945-a7c7-5f050a856e3f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:22.046477 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025cb3a-5c51-4945-a7c7-5f050a856e3f None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-f025cb3a-5c51-4945-a7c7-5f050a856e3f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:28:22.055145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:28:22.056309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:28:22.057180 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 408/818] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:28:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:28:22.062118 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf0b3f-1611-45bc-89e7-05a40f040653 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:22.120565 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:22.157461 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf0b3f-1611-45bc-89e7-05a40f040653 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:22.190131 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42a282-7c06-4489-9df6-e90395f16987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:22.190719 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42a282-7c06-4489-9df6-e90395f16987 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:22.190998 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42a282-7c06-4489-9df6-e90395f16987 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:22.191268 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42a282-7c06-4489-9df6-e90395f16987 None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:22.191881 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42a282-7c06-4489-9df6-e90395f16987 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:22.192180 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42a282-7c06-4489-9df6-e90395f16987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:22.193575 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42a282-7c06-4489-9df6-e90395f16987 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:22.198637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 411/819] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:28:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:28:22.204277 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025cb3a-5c51-4945-a7c7-5f050a856e3f None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:22.299161 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025cb3a-5c51-4945-a7c7-5f050a856e3f None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:22.321894 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:22.332310 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce579e-e11c-4095-b87b-b9fe62dc9b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:22.333758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce579e-e11c-4095-b87b-b9fe62dc9b6c None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:22.333758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce579e-e11c-4095-b87b-b9fe62dc9b6c None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:22.333758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce579e-e11c-4095-b87b-b9fe62dc9b6c None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:22.334085 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce579e-e11c-4095-b87b-b9fe62dc9b6c None admin] RBAC: Adding query filter params (type=compute) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:28:22.334384 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce579e-e11c-4095-b87b-b9fe62dc9b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:22.335721 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce579e-e11c-4095-b87b-b9fe62dc9b6c None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:22.340324 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 409/820] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 19 17:28:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:28:22.346294 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42a282-7c06-4489-9df6-e90395f16987 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:28:22.445547 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42a282-7c06-4489-9df6-e90395f16987 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:28:22.469748 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:22.478029 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef1bf2-ee0a-4aa6-8970-a5961b2b4a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:28:22.484168 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef1bf2-ee0a-4aa6-8970-a5961b2b4a61 None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:28:22.484168 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef1bf2-ee0a-4aa6-8970-a5961b2b4a61 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:28:22.484168 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef1bf2-ee0a-4aa6-8970-a5961b2b4a61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:28:22.484168 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef1bf2-ee0a-4aa6-8970-a5961b2b4a61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:28:22.484168 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef1bf2-ee0a-4aa6-8970-a5961b2b4a61 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:28:22.569310 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 412/821] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 19 17:28:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:28:32.352076 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=6 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:28:32.565051 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=8,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:41.667560 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb2334-e5d1-469b-8c20-a3415dec823d None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:41.668184 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb2334-e5d1-469b-8c20-a3415dec823d None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:41.668184 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb2334-e5d1-469b-8c20-a3415dec823d None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:41.670272 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 410/822] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:29:41.675944 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7f65c-3ea4-41d8-bd17-f8a33d4583c1 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:41.676386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7f65c-3ea4-41d8-bd17-f8a33d4583c1 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:41.676482 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7f65c-3ea4-41d8-bd17-f8a33d4583c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:41.694521 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-28b7f65c-3ea4-41d8-bd17-f8a33d4583c1 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:29:41.695693 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-28b7f65c-3ea4-41d8-bd17-f8a33d4583c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:29:41.767780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 413/823] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:29:41 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:29:42.102765 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb2334-e5d1-469b-8c20-a3415dec823d None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:42.209004 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb2334-e5d1-469b-8c20-a3415dec823d None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:42.254734 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7c6c1-0549-4bca-859a-cbb0d72c8ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:42.255395 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7c6c1-0549-4bca-859a-cbb0d72c8ff3 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:42.255683 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7c6c1-0549-4bca-859a-cbb0d72c8ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:42.256066 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7c6c1-0549-4bca-859a-cbb0d72c8ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:42.267726 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7c6c1-0549-4bca-859a-cbb0d72c8ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:42.269183 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7c6c1-0549-4bca-859a-cbb0d72c8ff3 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-8ad7c6c1-0549-4bca-859a-cbb0d72c8ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:29:42.290007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:42.303697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:29:42.304888 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:29:42.304888 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:42.304888 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:29:42.304888 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 411/824] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:42.305179 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7f65c-3ea4-41d8-bd17-f8a33d4583c1 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:42.406289 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7f65c-3ea4-41d8-bd17-f8a33d4583c1 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:42.433626 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:42.442211 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef2a42-9218-4435-9b09-e207d6ca5668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:42.442808 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef2a42-9218-4435-9b09-e207d6ca5668 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:42.443085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef2a42-9218-4435-9b09-e207d6ca5668 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:42.443355 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef2a42-9218-4435-9b09-e207d6ca5668 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:42.443985 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef2a42-9218-4435-9b09-e207d6ca5668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:42.444282 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef2a42-9218-4435-9b09-e207d6ca5668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:42.445685 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef2a42-9218-4435-9b09-e207d6ca5668 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:42.456992 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 414/825] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:42.462798 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7c6c1-0549-4bca-859a-cbb0d72c8ff3 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:42.516170 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:42.563809 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7c6c1-0549-4bca-859a-cbb0d72c8ff3 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:42.596376 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bdbe9-a560-45ac-b285-abc536bf4e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:42.596976 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bdbe9-a560-45ac-b285-abc536bf4e1f None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:42.597251 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bdbe9-a560-45ac-b285-abc536bf4e1f None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:42.597518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bdbe9-a560-45ac-b285-abc536bf4e1f None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:42.598148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bdbe9-a560-45ac-b285-abc536bf4e1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:42.599548 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bdbe9-a560-45ac-b285-abc536bf4e1f None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:42.740156 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 412/826] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 19 17:29:42 2022] POST /identity/v3/users => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:29:44.947515 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396b93-0181-4197-8504-32fb0b809ec7 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:44.948063 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396b93-0181-4197-8504-32fb0b809ec7 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:44.948063 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396b93-0181-4197-8504-32fb0b809ec7 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:44.949393 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 415/827] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:29:44.954591 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80880ec-4d7f-4cb1-b41d-27e65e2224ae None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:44.954982 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80880ec-4d7f-4cb1-b41d-27e65e2224ae None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:44.955143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80880ec-4d7f-4cb1-b41d-27e65e2224ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:44.972964 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-e80880ec-4d7f-4cb1-b41d-27e65e2224ae None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:29:44.974152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-e80880ec-4d7f-4cb1-b41d-27e65e2224ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:29:45.056253 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 413/828] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:29:44 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:29:45.440505 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c396b93-0181-4197-8504-32fb0b809ec7 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:45.556681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c396b93-0181-4197-8504-32fb0b809ec7 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:45.593604 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a99cf8-4cb2-434d-94a3-316fdefcf8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:45.594248 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a99cf8-4cb2-434d-94a3-316fdefcf8e0 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:45.594505 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a99cf8-4cb2-434d-94a3-316fdefcf8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:45.594773 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a99cf8-4cb2-434d-94a3-316fdefcf8e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:45.606074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a99cf8-4cb2-434d-94a3-316fdefcf8e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-b6a99cf8-4cb2-434d-94a3-316fdefcf8e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:29:45.610886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:45.612099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:29:45.613154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 416/829] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:29:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:45.618064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80880ec-4d7f-4cb1-b41d-27e65e2224ae None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:45.663104 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:45.736712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80880ec-4d7f-4cb1-b41d-27e65e2224ae None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:45.785161 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d0806-2481-4971-a7d4-55b8813c8e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:45.785769 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d0806-2481-4971-a7d4-55b8813c8e3f None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:45.786089 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d0806-2481-4971-a7d4-55b8813c8e3f None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:45.786358 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d0806-2481-4971-a7d4-55b8813c8e3f None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:45.787017 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d0806-2481-4971-a7d4-55b8813c8e3f None admin] RBAC: Adding query filter params (name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:45.787313 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d0806-2481-4971-a7d4-55b8813c8e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:45.789104 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d0806-2481-4971-a7d4-55b8813c8e3f None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:45.802114 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 414/830] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:29:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:45.808068 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a99cf8-4cb2-434d-94a3-316fdefcf8e0 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:45.855148 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:45.906809 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a99cf8-4cb2-434d-94a3-316fdefcf8e0 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:45.939417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b6a6-92a3-4cc9-8abd-a825db3c7634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:45.940040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b6a6-92a3-4cc9-8abd-a825db3c7634 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:45.940321 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b6a6-92a3-4cc9-8abd-a825db3c7634 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:45.940601 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b6a6-92a3-4cc9-8abd-a825db3c7634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:45.950952 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8b6a6-92a3-4cc9-8abd-a825db3c7634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:45.952922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8b6a6-92a3-4cc9-8abd-a825db3c7634 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-b8f8b6a6-92a3-4cc9-8abd-a825db3c7634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:29:45.966419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:45.967622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:29:45.968572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:29:45.968572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:45.968572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:29:45.968572 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 417/831] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:45.973553 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d0806-2481-4971-a7d4-55b8813c8e3f None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:46.071107 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:46.074094 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d0806-2481-4971-a7d4-55b8813c8e3f None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:46.113211 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4aa3-e46f-42f0-85fc-20dcea35ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:46.113825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4aa3-e46f-42f0-85fc-20dcea35ce99 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:46.114143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4aa3-e46f-42f0-85fc-20dcea35ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:46.114624 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4aa3-e46f-42f0-85fc-20dcea35ce99 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:46.115264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f4aa3-e46f-42f0-85fc-20dcea35ce99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:46.115559 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f4aa3-e46f-42f0-85fc-20dcea35ce99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:46.116943 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f4aa3-e46f-42f0-85fc-20dcea35ce99 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:46.131185 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 415/832] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:29:46.137251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b6a6-92a3-4cc9-8abd-a825db3c7634 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:46.233577 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:46.237326 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b6a6-92a3-4cc9-8abd-a825db3c7634 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:46.270130 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a613d64-330e-44b2-a5ab-27b7db49846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:46.270749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a613d64-330e-44b2-a5ab-27b7db49846e None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:46.271026 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a613d64-330e-44b2-a5ab-27b7db49846e None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:46.271293 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a613d64-330e-44b2-a5ab-27b7db49846e None admin] PATH_INFO: `/v3/users/placement` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:46.278182 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a613d64-330e-44b2-a5ab-27b7db49846e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:46.279614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a613d64-330e-44b2-a5ab-27b7db49846e None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-2a613d64-330e-44b2-a5ab-27b7db49846e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:29:46.290653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:46.297807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:46.299296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:46.299296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:46.299296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:29:46.299296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:29:46.299296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:29:46.299296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:29:46.299296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:29:46.299296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:29:46.299296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:29:46.299296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:29:46.299296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 418/833] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:29:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:46.300049 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4aa3-e46f-42f0-85fc-20dcea35ce99 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:46.398273 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4aa3-e46f-42f0-85fc-20dcea35ce99 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:46.436427 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e0602-d7ce-4fe7-bdbd-09878e3e66a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:46.439990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e0602-d7ce-4fe7-bdbd-09878e3e66a6 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:46.439990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e0602-d7ce-4fe7-bdbd-09878e3e66a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:46.439990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e0602-d7ce-4fe7-bdbd-09878e3e66a6 None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:46.439990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e0602-d7ce-4fe7-bdbd-09878e3e66a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:46.439990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e0602-d7ce-4fe7-bdbd-09878e3e66a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:46.439990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e0602-d7ce-4fe7-bdbd-09878e3e66a6 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:46.460376 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 416/834] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 19 17:29:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:46.466409 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a613d64-330e-44b2-a5ab-27b7db49846e None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:46.570314 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a613d64-330e-44b2-a5ab-27b7db49846e None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:46.606598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69191d2-994c-4894-8fb2-df838d1b0ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:46.607792 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69191d2-994c-4894-8fb2-df838d1b0ada None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:46.608063 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69191d2-994c-4894-8fb2-df838d1b0ada None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:46.608331 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69191d2-994c-4894-8fb2-df838d1b0ada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:46.634397 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:46.679454 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69191d2-994c-4894-8fb2-df838d1b0ada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:46.680960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69191d2-994c-4894-8fb2-df838d1b0ada None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:46.778144 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 419/835] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:29:46 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 17:29:46.784470 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e0602-d7ce-4fe7-bdbd-09878e3e66a6 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:46.804345 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:46.882714 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e0602-d7ce-4fe7-bdbd-09878e3e66a6 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:46.916077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9741b-1b31-43ba-8a4f-44b18ac0f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:46.916692 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9741b-1b31-43ba-8a4f-44b18ac0f005 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:46.917002 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9741b-1b31-43ba-8a4f-44b18ac0f005 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:46.917273 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9741b-1b31-43ba-8a4f-44b18ac0f005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:46.927903 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9741b-1b31-43ba-8a4f-44b18ac0f005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:46.929409 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9741b-1b31-43ba-8a4f-44b18ac0f005 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-93b9741b-1b31-43ba-8a4f-44b18ac0f005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:29:46.943431 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:46.944545 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:29:46.945833 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:29:46.945833 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:46.945833 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:29:46.945833 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 417/836] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:46.952945 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69191d2-994c-4894-8fb2-df838d1b0ada None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:47.015176 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:47.054899 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69191d2-994c-4894-8fb2-df838d1b0ada None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:47.099593 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c1cda-dee9-4503-88c6-aacc19fa7499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:47.100200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c1cda-dee9-4503-88c6-aacc19fa7499 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:47.101888 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c1cda-dee9-4503-88c6-aacc19fa7499 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:47.101888 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c1cda-dee9-4503-88c6-aacc19fa7499 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:47.101888 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c1cda-dee9-4503-88c6-aacc19fa7499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:47.101888 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c1cda-dee9-4503-88c6-aacc19fa7499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:47.103080 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c1cda-dee9-4503-88c6-aacc19fa7499 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:47.114479 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 420/837] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:47.120190 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9741b-1b31-43ba-8a4f-44b18ac0f005 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:47.188248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:47.218938 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9741b-1b31-43ba-8a4f-44b18ac0f005 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:47.250443 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc8979-c34f-42d3-840e-b940f0dc0f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:47.251051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8979-c34f-42d3-840e-b940f0dc0f8d None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:47.251325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8979-c34f-42d3-840e-b940f0dc0f8d None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:47.251592 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8979-c34f-42d3-840e-b940f0dc0f8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:47.258018 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc8979-c34f-42d3-840e-b940f0dc0f8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:47.263809 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc8979-c34f-42d3-840e-b940f0dc0f8d None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-1bcc8979-c34f-42d3-840e-b940f0dc0f8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:29:47.270854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:47.271878 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:47.272918 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:29:47.272918 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:29:47.272918 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:29:47.272918 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:29:47.272918 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:29:47.272918 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:29:47.272918 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:29:47.272918 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:29:47.272918 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 418/838] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:29:47.277871 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c1cda-dee9-4503-88c6-aacc19fa7499 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:47.377824 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c1cda-dee9-4503-88c6-aacc19fa7499 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:47.395216 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:47.411184 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1a3df-c8fe-4e3d-9dd9-63925f08c4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:47.411788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1a3df-c8fe-4e3d-9dd9-63925f08c4b5 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:47.412066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1a3df-c8fe-4e3d-9dd9-63925f08c4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:47.412333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1a3df-c8fe-4e3d-9dd9-63925f08c4b5 None admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:47.413051 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1a3df-c8fe-4e3d-9dd9-63925f08c4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:47.413356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1a3df-c8fe-4e3d-9dd9-63925f08c4b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:47.414784 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1a3df-c8fe-4e3d-9dd9-63925f08c4b5 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:47.433401 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 421/839] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:29:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:47.440261 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc8979-c34f-42d3-840e-b940f0dc0f8d None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:47.543767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc8979-c34f-42d3-840e-b940f0dc0f8d None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:47.571371 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:47.577713 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13891d-488d-4265-b945-214c30d44dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:47.578310 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13891d-488d-4265-b945-214c30d44dab None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:47.578583 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13891d-488d-4265-b945-214c30d44dab None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:47.578852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13891d-488d-4265-b945-214c30d44dab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:47.579592 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13891d-488d-4265-b945-214c30d44dab None admin] RBAC: Adding query filter params (role.id=80dbe26dc5454ef49e2feba96589b473, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=82313d212e4f454697849ea186208785) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:47.579897 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13891d-488d-4265-b945-214c30d44dab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:47.581349 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13891d-488d-4265-b945-214c30d44dab None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:47.586765 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 419/840] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:29:47 2022] GET /identity/v3/role_assignments?user.id=82313d212e4f454697849ea186208785&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=80dbe26dc5454ef49e2feba96589b473 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:29:49.754273 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7b234-760c-4536-a0c6-c72e3c4263a8 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:49.754788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7b234-760c-4536-a0c6-c72e3c4263a8 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:49.754788 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7b234-760c-4536-a0c6-c72e3c4263a8 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:49.756108 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 422/841] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:29:49.761353 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b3349-9e1d-43c7-8697-fdd1b6fcb605 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:49.761741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b3349-9e1d-43c7-8697-fdd1b6fcb605 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:49.761890 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b3349-9e1d-43c7-8697-fdd1b6fcb605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:49.779930 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-6e7b3349-9e1d-43c7-8697-fdd1b6fcb605 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:29:49.781126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-6e7b3349-9e1d-43c7-8697-fdd1b6fcb605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:29:49.845986 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 420/842] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:29:49 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:29:50.166582 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7b234-760c-4536-a0c6-c72e3c4263a8 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:50.265104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7b234-760c-4536-a0c6-c72e3c4263a8 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:50.297325 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b85915-9442-4f8f-be3b-0698156dfe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:50.304540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b85915-9442-4f8f-be3b-0698156dfe80 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:50.304540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b85915-9442-4f8f-be3b-0698156dfe80 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:50.304540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b85915-9442-4f8f-be3b-0698156dfe80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:50.309558 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b85915-9442-4f8f-be3b-0698156dfe80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-08b85915-9442-4f8f-be3b-0698156dfe80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:29:50.314718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:50.315914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:29:50.316829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 423/843] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:29:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:50.321787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b3349-9e1d-43c7-8697-fdd1b6fcb605 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:50.416441 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b3349-9e1d-43c7-8697-fdd1b6fcb605 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:50.440248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:50.451702 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce3c15-d4be-4400-aeb2-ba3c661c7b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:50.452294 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce3c15-d4be-4400-aeb2-ba3c661c7b3b None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:50.452563 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce3c15-d4be-4400-aeb2-ba3c661c7b3b None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:50.452862 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce3c15-d4be-4400-aeb2-ba3c661c7b3b None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:50.453511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce3c15-d4be-4400-aeb2-ba3c661c7b3b None admin] RBAC: Adding query filter params (name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:50.453807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce3c15-d4be-4400-aeb2-ba3c661c7b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:50.455153 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce3c15-d4be-4400-aeb2-ba3c661c7b3b None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:50.463072 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 421/844] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:29:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:50.468851 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b85915-9442-4f8f-be3b-0698156dfe80 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:50.507657 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:50.565238 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b85915-9442-4f8f-be3b-0698156dfe80 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:50.596915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea55c3-eaee-496c-8d08-f444a6e7313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:50.597523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea55c3-eaee-496c-8d08-f444a6e7313d None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:50.597800 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea55c3-eaee-496c-8d08-f444a6e7313d None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:50.598065 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea55c3-eaee-496c-8d08-f444a6e7313d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:50.608328 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea55c3-eaee-496c-8d08-f444a6e7313d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:50.609792 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea55c3-eaee-496c-8d08-f444a6e7313d None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-a6ea55c3-eaee-496c-8d08-f444a6e7313d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:29:50.625681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:50.626724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:29:50.627624 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:29:50.627624 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:50.627624 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:29:50.627624 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 424/845] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:50.632632 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce3c15-d4be-4400-aeb2-ba3c661c7b3b None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:50.729557 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce3c15-d4be-4400-aeb2-ba3c661c7b3b None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:50.762469 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3b3c-b006-4735-80a1-caed69ec174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:50.763068 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3b3c-b006-4735-80a1-caed69ec174c None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:50.763394 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3b3c-b006-4735-80a1-caed69ec174c None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:50.763672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3b3c-b006-4735-80a1-caed69ec174c None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:50.764306 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd3b3c-b006-4735-80a1-caed69ec174c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:50.769550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd3b3c-b006-4735-80a1-caed69ec174c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:50.769550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd3b3c-b006-4735-80a1-caed69ec174c None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:50.777286 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 422/846] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:50.783168 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea55c3-eaee-496c-8d08-f444a6e7313d None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:50.871155 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:50.881622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea55c3-eaee-496c-8d08-f444a6e7313d None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:50.913507 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7b8cc-99f7-4fd3-b367-3ee6317c6811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:50.914128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7b8cc-99f7-4fd3-b367-3ee6317c6811 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:50.914406 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7b8cc-99f7-4fd3-b367-3ee6317c6811 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:50.914677 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7b8cc-99f7-4fd3-b367-3ee6317c6811 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:50.921932 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7b8cc-99f7-4fd3-b367-3ee6317c6811 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:50.923363 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7b8cc-99f7-4fd3-b367-3ee6317c6811 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-30e7b8cc-99f7-4fd3-b367-3ee6317c6811 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:29:50.934661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:50.936448 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:50.937665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:50.937665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:50.937665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:29:50.937665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:29:50.937665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:29:50.937665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:29:50.937665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:29:50.937665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:29:50.937665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:29:50.937665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:29:50.937665 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 425/847] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:29:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:50.942226 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3b3c-b006-4735-80a1-caed69ec174c None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:50.989706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:51.039972 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3b3c-b006-4735-80a1-caed69ec174c None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:51.072726 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad538c-2cd5-43de-9b96-b50187dd96bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:51.073332 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad538c-2cd5-43de-9b96-b50187dd96bf None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:51.073608 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad538c-2cd5-43de-9b96-b50187dd96bf None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:51.073876 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad538c-2cd5-43de-9b96-b50187dd96bf None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:51.074586 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad538c-2cd5-43de-9b96-b50187dd96bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:51.074888 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad538c-2cd5-43de-9b96-b50187dd96bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:51.076358 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad538c-2cd5-43de-9b96-b50187dd96bf None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:51.093315 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 423/848] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 19 17:29:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:51.098988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7b8cc-99f7-4fd3-b367-3ee6317c6811 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:51.204150 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7b8cc-99f7-4fd3-b367-3ee6317c6811 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:51.237271 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96969636-a582-4cb8-b5b6-5eace0129b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:51.237889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96969636-a582-4cb8-b5b6-5eace0129b60 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:51.238167 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96969636-a582-4cb8-b5b6-5eace0129b60 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:51.238438 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96969636-a582-4cb8-b5b6-5eace0129b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:51.248772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96969636-a582-4cb8-b5b6-5eace0129b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:51.250151 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96969636-a582-4cb8-b5b6-5eace0129b60 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-96969636-a582-4cb8-b5b6-5eace0129b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:29:51.263541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:51.264648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:29:51.266013 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:29:51.266013 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:51.266013 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:29:51.266013 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 426/849] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:51.270495 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad538c-2cd5-43de-9b96-b50187dd96bf None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:51.368608 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad538c-2cd5-43de-9b96-b50187dd96bf None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:51.370887 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:51.400468 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fc7ec-3673-4e3f-b3ee-ebee80ac4d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:51.401109 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fc7ec-3673-4e3f-b3ee-ebee80ac4d69 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:51.401386 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fc7ec-3673-4e3f-b3ee-ebee80ac4d69 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:51.401658 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fc7ec-3673-4e3f-b3ee-ebee80ac4d69 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:51.402290 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fc7ec-3673-4e3f-b3ee-ebee80ac4d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:51.402590 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fc7ec-3673-4e3f-b3ee-ebee80ac4d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:51.404446 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fc7ec-3673-4e3f-b3ee-ebee80ac4d69 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:51.415314 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 424/850] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:51.421893 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96969636-a582-4cb8-b5b6-5eace0129b60 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:51.425043 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:51.524680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96969636-a582-4cb8-b5b6-5eace0129b60 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:51.556974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1aa44-6063-4f40-87c7-19e24cb87559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:51.557594 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1aa44-6063-4f40-87c7-19e24cb87559 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:51.557873 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1aa44-6063-4f40-87c7-19e24cb87559 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:51.558142 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1aa44-6063-4f40-87c7-19e24cb87559 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:51.564663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1aa44-6063-4f40-87c7-19e24cb87559 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:51.566113 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1aa44-6063-4f40-87c7-19e24cb87559 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-32e1aa44-6063-4f40-87c7-19e24cb87559 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:29:51.577540 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:51.578497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:51.579385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:29:51.579385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:29:51.579385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:29:51.579385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:29:51.579385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:29:51.579385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:29:51.579385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:29:51.579385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:29:51.579385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 427/851] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:29:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:29:51.584489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fc7ec-3673-4e3f-b3ee-ebee80ac4d69 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:51.682219 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fc7ec-3673-4e3f-b3ee-ebee80ac4d69 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:51.714928 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49a47b-86c7-4777-a256-f990706f0b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:51.715520 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49a47b-86c7-4777-a256-f990706f0b01 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:51.715798 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49a47b-86c7-4777-a256-f990706f0b01 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:51.716654 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49a47b-86c7-4777-a256-f990706f0b01 None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:51.717367 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49a47b-86c7-4777-a256-f990706f0b01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:51.717670 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49a47b-86c7-4777-a256-f990706f0b01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:51.719078 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49a47b-86c7-4777-a256-f990706f0b01 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:51.730551 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 425/852] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:29:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:51.736644 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1aa44-6063-4f40-87c7-19e24cb87559 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:51.797700 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:51.834904 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1aa44-6063-4f40-87c7-19e24cb87559 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:51.866427 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b7cd9-1433-4472-a3ea-99a2b18bd080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:51.867101 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b7cd9-1433-4472-a3ea-99a2b18bd080 None admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:51.867378 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b7cd9-1433-4472-a3ea-99a2b18bd080 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:51.867648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b7cd9-1433-4472-a3ea-99a2b18bd080 None admin] PATH_INFO: `/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/82313d212e4f454697849ea186208785/roles/80dbe26dc5454ef49e2feba96589b473` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:51.883877 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b7cd9-1433-4472-a3ea-99a2b18bd080 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b84e7b6ac1644538bb6ef2874a1f0cf, user_id=82313d212e4f454697849ea186208785, role_id=80dbe26dc5454ef49e2feba96589b473)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:51.885609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b7cd9-1433-4472-a3ea-99a2b18bd080 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:52.035425 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 428/853] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:29:51 2022] PUT /identity/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/82313d212e4f454697849ea186208785/roles/80dbe26dc5454ef49e2feba96589b473 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:29:54.179806 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bcade-a04b-4397-8f57-3db0438d3833 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:54.180348 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bcade-a04b-4397-8f57-3db0438d3833 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:54.180348 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bcade-a04b-4397-8f57-3db0438d3833 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:54.181703 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 426/854] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:29:54.187031 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b61c3-511b-4231-8b25-f2f05233ac1f None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:54.187618 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b61c3-511b-4231-8b25-f2f05233ac1f None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:54.187713 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b61c3-511b-4231-8b25-f2f05233ac1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:54.204960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-995b61c3-511b-4231-8b25-f2f05233ac1f None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:29:54.206120 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-995b61c3-511b-4231-8b25-f2f05233ac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:29:54.271291 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 429/855] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:29:54 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:29:54.598740 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bcade-a04b-4397-8f57-3db0438d3833 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:54.623372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:54.696678 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bcade-a04b-4397-8f57-3db0438d3833 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:54.729811 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f4f49-9211-4dfa-a86d-a19aba95e375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:54.730418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f4f49-9211-4dfa-a86d-a19aba95e375 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:54.730695 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f4f49-9211-4dfa-a86d-a19aba95e375 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:54.730969 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f4f49-9211-4dfa-a86d-a19aba95e375 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:54.740821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f4f49-9211-4dfa-a86d-a19aba95e375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-886f4f49-9211-4dfa-a86d-a19aba95e375 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:29:54.745463 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:54.746601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:29:54.747437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 427/856] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 19 17:29:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:54.752655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b61c3-511b-4231-8b25-f2f05233ac1f None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:54.796917 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:54.850647 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b61c3-511b-4231-8b25-f2f05233ac1f None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:54.883332 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885c8b0-a09d-4929-a1be-4d00115c6d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:54.883929 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885c8b0-a09d-4929-a1be-4d00115c6d35 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:54.884231 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885c8b0-a09d-4929-a1be-4d00115c6d35 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:54.884499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885c8b0-a09d-4929-a1be-4d00115c6d35 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:54.885176 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885c8b0-a09d-4929-a1be-4d00115c6d35 None admin] RBAC: Adding query filter params (name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:54.885473 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885c8b0-a09d-4929-a1be-4d00115c6d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:54.887111 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885c8b0-a09d-4929-a1be-4d00115c6d35 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:54.895690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 430/857] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 19 17:29:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:54.901506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f4f49-9211-4dfa-a86d-a19aba95e375 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:54.986144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:55.001065 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f4f49-9211-4dfa-a86d-a19aba95e375 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:55.032858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb5768-c10a-4a77-821a-8bc466b24f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:55.033464 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb5768-c10a-4a77-821a-8bc466b24f6a None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:55.033738 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb5768-c10a-4a77-821a-8bc466b24f6a None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:55.034006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb5768-c10a-4a77-821a-8bc466b24f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:55.044208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb5768-c10a-4a77-821a-8bc466b24f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:55.046296 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb5768-c10a-4a77-821a-8bc466b24f6a None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-4bdb5768-c10a-4a77-821a-8bc466b24f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:29:55.060102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:55.061236 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:29:55.062349 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:29:55.062349 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:55.062349 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:29:55.062349 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 428/858] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:55.067072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885c8b0-a09d-4929-a1be-4d00115c6d35 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:55.183259 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885c8b0-a09d-4929-a1be-4d00115c6d35 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:55.185590 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:55.215854 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70645e1-8494-46ca-8c10-2c35aff5443f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:55.216446 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70645e1-8494-46ca-8c10-2c35aff5443f None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:55.216806 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70645e1-8494-46ca-8c10-2c35aff5443f None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:55.217082 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70645e1-8494-46ca-8c10-2c35aff5443f None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:55.218255 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70645e1-8494-46ca-8c10-2c35aff5443f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:55.218548 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70645e1-8494-46ca-8c10-2c35aff5443f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:55.219901 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70645e1-8494-46ca-8c10-2c35aff5443f None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:55.230523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 431/859] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:55.236211 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb5768-c10a-4a77-821a-8bc466b24f6a None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:55.335446 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb5768-c10a-4a77-821a-8bc466b24f6a None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:55.368242 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09492d63-d50c-429b-912a-35d195471251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:55.368887 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09492d63-d50c-429b-912a-35d195471251 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:55.369169 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09492d63-d50c-429b-912a-35d195471251 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:55.369444 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09492d63-d50c-429b-912a-35d195471251 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:55.372022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:55.377656 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09492d63-d50c-429b-912a-35d195471251 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:55.379119 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09492d63-d50c-429b-912a-35d195471251 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-09492d63-d50c-429b-912a-35d195471251 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:29:55.390617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:55.391712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:55.392708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:55.392708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:55.392708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:29:55.392708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:29:55.392708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:29:55.392708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:29:55.392708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:29:55.392708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:29:55.392708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:29:55.392708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:29:55.392708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 429/860] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:29:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:55.397934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70645e1-8494-46ca-8c10-2c35aff5443f None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:55.504478 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70645e1-8494-46ca-8c10-2c35aff5443f None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:55.538207 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599b1ba-d895-494d-b5cb-55ba0646c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:55.538818 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599b1ba-d895-494d-b5cb-55ba0646c8af None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:55.539084 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599b1ba-d895-494d-b5cb-55ba0646c8af None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:55.539357 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599b1ba-d895-494d-b5cb-55ba0646c8af None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:55.540068 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599b1ba-d895-494d-b5cb-55ba0646c8af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:55.540371 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599b1ba-d895-494d-b5cb-55ba0646c8af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:55.541821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599b1ba-d895-494d-b5cb-55ba0646c8af None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:55.558654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 432/861] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 19 17:29:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:55.565093 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09492d63-d50c-429b-912a-35d195471251 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:55.665232 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09492d63-d50c-429b-912a-35d195471251 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:55.698162 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab3adf-35c4-4b79-993d-90dd8fe5a661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:55.698722 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab3adf-35c4-4b79-993d-90dd8fe5a661 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:55.699004 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab3adf-35c4-4b79-993d-90dd8fe5a661 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:55.699277 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab3adf-35c4-4b79-993d-90dd8fe5a661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:55.758916 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:55.765715 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab3adf-35c4-4b79-993d-90dd8fe5a661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:55.767156 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab3adf-35c4-4b79-993d-90dd8fe5a661 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:55.863660 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 430/862] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:29:55 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 17:29:55.869358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599b1ba-d895-494d-b5cb-55ba0646c8af None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:55.894367 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:55.968528 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599b1ba-d895-494d-b5cb-55ba0646c8af None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:56.001443 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db762a3-ab63-47b7-bda2-23f0d76d0a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:56.002058 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db762a3-ab63-47b7-bda2-23f0d76d0a02 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:56.002331 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db762a3-ab63-47b7-bda2-23f0d76d0a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:56.002600 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db762a3-ab63-47b7-bda2-23f0d76d0a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:56.018738 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db762a3-ab63-47b7-bda2-23f0d76d0a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:56.018738 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db762a3-ab63-47b7-bda2-23f0d76d0a02 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-3db762a3-ab63-47b7-bda2-23f0d76d0a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:29:56.027584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:56.028496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:29:56.029522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:29:56.029522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:56.029522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:29:56.029522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 433/863] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:56.034427 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab3adf-35c4-4b79-993d-90dd8fe5a661 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:56.127813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:56.133748 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab3adf-35c4-4b79-993d-90dd8fe5a661 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:56.166599 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd3c8f-1ab4-4ff7-ab90-5531633b0861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:56.167188 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd3c8f-1ab4-4ff7-ab90-5531633b0861 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:56.167464 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd3c8f-1ab4-4ff7-ab90-5531633b0861 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:56.167733 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd3c8f-1ab4-4ff7-ab90-5531633b0861 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:56.168358 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd3c8f-1ab4-4ff7-ab90-5531633b0861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:56.168714 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd3c8f-1ab4-4ff7-ab90-5531633b0861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:56.170617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd3c8f-1ab4-4ff7-ab90-5531633b0861 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:56.181935 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 431/864] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:56.188190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db762a3-ab63-47b7-bda2-23f0d76d0a02 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:56.260406 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:56.284002 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db762a3-ab63-47b7-bda2-23f0d76d0a02 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:56.315856 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303859c-e576-4519-8045-3bd016922426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:56.316467 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303859c-e576-4519-8045-3bd016922426 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:56.316770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303859c-e576-4519-8045-3bd016922426 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:56.317040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303859c-e576-4519-8045-3bd016922426 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:56.323351 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303859c-e576-4519-8045-3bd016922426 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:56.324807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303859c-e576-4519-8045-3bd016922426 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-0303859c-e576-4519-8045-3bd016922426 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:29:56.337390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:56.343533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:56.344578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:29:56.344578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:29:56.344578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:29:56.344578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:29:56.344578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:29:56.344578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:29:56.344578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:29:56.344578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:29:56.344578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 434/865] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:29:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:56.345133 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd3c8f-1ab4-4ff7-ab90-5531633b0861 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:56.443773 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd3c8f-1ab4-4ff7-ab90-5531633b0861 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:56.478161 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac40430-9b3c-4611-8b2a-593576a0435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:56.478749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac40430-9b3c-4611-8b2a-593576a0435e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:56.479024 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac40430-9b3c-4611-8b2a-593576a0435e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:56.479290 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac40430-9b3c-4611-8b2a-593576a0435e None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:56.479965 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac40430-9b3c-4611-8b2a-593576a0435e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:56.480269 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac40430-9b3c-4611-8b2a-593576a0435e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:56.481758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac40430-9b3c-4611-8b2a-593576a0435e None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:56.494246 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 432/866] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:29:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:29:56.500320 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303859c-e576-4519-8045-3bd016922426 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:56.596575 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303859c-e576-4519-8045-3bd016922426 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:56.628387 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780db17-5a69-4157-913e-01fed41f11e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:56.629001 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780db17-5a69-4157-913e-01fed41f11e4 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:56.629279 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780db17-5a69-4157-913e-01fed41f11e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:56.629549 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780db17-5a69-4157-913e-01fed41f11e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:56.630269 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780db17-5a69-4157-913e-01fed41f11e4 None admin] RBAC: Adding query filter params (role.id=80dbe26dc5454ef49e2feba96589b473, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=82313d212e4f454697849ea186208785) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:56.630587 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780db17-5a69-4157-913e-01fed41f11e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:56.631993 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780db17-5a69-4157-913e-01fed41f11e4 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:56.633780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:56.638086 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 435/867] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:29:56 2022] GET /identity/v3/role_assignments?user.id=82313d212e4f454697849ea186208785&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=80dbe26dc5454ef49e2feba96589b473 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:58.841952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53ae0-02f5-4334-b147-9c1c5b742d24 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:58.842466 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53ae0-02f5-4334-b147-9c1c5b742d24 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:58.842466 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53ae0-02f5-4334-b147-9c1c5b742d24 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:58.843758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 433/868] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:29:58.849062 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6172e1-b4ea-43e9-97ce-677bfc09f4ce None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:58.849463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6172e1-b4ea-43e9-97ce-677bfc09f4ce None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:58.849613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6172e1-b4ea-43e9-97ce-677bfc09f4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:58.867541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-fa6172e1-b4ea-43e9-97ce-677bfc09f4ce None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:29:58.868749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-fa6172e1-b4ea-43e9-97ce-677bfc09f4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:29:58.938799 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 436/869] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:29:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:29:59.265950 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53ae0-02f5-4334-b147-9c1c5b742d24 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:59.284389 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:59.366035 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53ae0-02f5-4334-b147-9c1c5b742d24 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:59.398507 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aae990-794b-4afd-a4ea-aaf37dba0e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:59.399130 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aae990-794b-4afd-a4ea-aaf37dba0e51 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:59.399407 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aae990-794b-4afd-a4ea-aaf37dba0e51 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:59.399675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aae990-794b-4afd-a4ea-aaf37dba0e51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:59.409821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aae990-794b-4afd-a4ea-aaf37dba0e51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-d5aae990-794b-4afd-a4ea-aaf37dba0e51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:29:59.414829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:59.420528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:29:59.421884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 434/870] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:29:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:59.423054 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6172e1-b4ea-43e9-97ce-677bfc09f4ce None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:59.519039 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6172e1-b4ea-43e9-97ce-677bfc09f4ce None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:59.545915 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:59.553589 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65665df8-c02b-4277-b45b-fbea65831194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:59.554189 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65665df8-c02b-4277-b45b-fbea65831194 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:59.554467 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65665df8-c02b-4277-b45b-fbea65831194 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:59.554738 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65665df8-c02b-4277-b45b-fbea65831194 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:59.555452 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65665df8-c02b-4277-b45b-fbea65831194 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:59.555738 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65665df8-c02b-4277-b45b-fbea65831194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:59.557121 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65665df8-c02b-4277-b45b-fbea65831194 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:59.564837 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 437/871] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:59.570712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aae990-794b-4afd-a4ea-aaf37dba0e51 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:59.646837 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:29:59.670917 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aae990-794b-4afd-a4ea-aaf37dba0e51 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:59.704257 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31e04f-3cb7-4411-99a2-3da3f289dad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:59.704911 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e04f-3cb7-4411-99a2-3da3f289dad4 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:59.705193 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e04f-3cb7-4411-99a2-3da3f289dad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:59.705465 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e04f-3cb7-4411-99a2-3da3f289dad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:59.715860 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31e04f-3cb7-4411-99a2-3da3f289dad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:59.717942 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31e04f-3cb7-4411-99a2-3da3f289dad4 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-9b31e04f-3cb7-4411-99a2-3da3f289dad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:29:59.732137 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:29:59.733270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:29:59.734323 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:29:59.734323 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:29:59.734323 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:29:59.734323 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 435/872] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:29:59.739060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65665df8-c02b-4277-b45b-fbea65831194 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:59.836473 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65665df8-c02b-4277-b45b-fbea65831194 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:29:59.870166 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4887b7-4b0e-4882-931a-a976799421e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:29:59.870758 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4887b7-4b0e-4882-931a-a976799421e4 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:29:59.871030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4887b7-4b0e-4882-931a-a976799421e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:29:59.871299 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4887b7-4b0e-4882-931a-a976799421e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:29:59.871931 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4887b7-4b0e-4882-931a-a976799421e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:29:59.872229 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4887b7-4b0e-4882-931a-a976799421e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:29:59.873618 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4887b7-4b0e-4882-931a-a976799421e4 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:29:59.885167 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 438/873] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:29:59.891526 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31e04f-3cb7-4411-99a2-3da3f289dad4 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:29:59.992083 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31e04f-3cb7-4411-99a2-3da3f289dad4 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:00.017809 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:00.025390 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedfe41-c83e-4c27-a8eb-ebb116727f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:00.026001 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedfe41-c83e-4c27-a8eb-ebb116727f31 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:00.026276 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedfe41-c83e-4c27-a8eb-ebb116727f31 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:00.026542 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedfe41-c83e-4c27-a8eb-ebb116727f31 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:00.034229 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedfe41-c83e-4c27-a8eb-ebb116727f31 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:00.035766 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedfe41-c83e-4c27-a8eb-ebb116727f31 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-2cedfe41-c83e-4c27-a8eb-ebb116727f31 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:30:00.046821 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:00.048006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:00.049489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:00.049489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:00.049489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:30:00.049489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:30:00.049489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:30:00.049489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:30:00.049489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:30:00.049489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:30:00.049489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:30:00.049489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:30:00.049489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 436/874] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:29:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:00.054063 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4887b7-4b0e-4882-931a-a976799421e4 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:00.102477 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:00.149874 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4887b7-4b0e-4882-931a-a976799421e4 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:00.182160 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0471e-72d1-4ace-9334-511fb8fd9eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:00.182746 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0471e-72d1-4ace-9334-511fb8fd9eaf None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:00.183020 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0471e-72d1-4ace-9334-511fb8fd9eaf None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:00.183286 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0471e-72d1-4ace-9334-511fb8fd9eaf None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:00.183990 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0471e-72d1-4ace-9334-511fb8fd9eaf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:00.184286 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0471e-72d1-4ace-9334-511fb8fd9eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:00.186267 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0471e-72d1-4ace-9334-511fb8fd9eaf None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:00.203764 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 439/875] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 19 17:30:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:00.209524 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedfe41-c83e-4c27-a8eb-ebb116727f31 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:00.305828 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedfe41-c83e-4c27-a8eb-ebb116727f31 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:00.338360 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b38d6-1039-4161-86b3-9b0cf874a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:00.338946 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b38d6-1039-4161-86b3-9b0cf874a862 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:00.339225 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b38d6-1039-4161-86b3-9b0cf874a862 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:00.339491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b38d6-1039-4161-86b3-9b0cf874a862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:00.392554 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:00.404261 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b38d6-1039-4161-86b3-9b0cf874a862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:00.405725 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b38d6-1039-4161-86b3-9b0cf874a862 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:00.501866 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 437/876] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:30:00 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 17:30:00.507627 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0471e-72d1-4ace-9334-511fb8fd9eaf None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:00.603433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0471e-72d1-4ace-9334-511fb8fd9eaf None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:00.613278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:00.638594 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6288a65-5982-421d-ad6f-f331b8f0e4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:00.639250 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6288a65-5982-421d-ad6f-f331b8f0e4cb None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:00.639527 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6288a65-5982-421d-ad6f-f331b8f0e4cb None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:00.639815 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6288a65-5982-421d-ad6f-f331b8f0e4cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:00.649775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6288a65-5982-421d-ad6f-f331b8f0e4cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:00.651200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6288a65-5982-421d-ad6f-f331b8f0e4cb None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-b6288a65-5982-421d-ad6f-f331b8f0e4cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:30:00.664906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:00.666017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:30:00.667140 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:30:00.667140 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:30:00.667140 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:00.667140 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 440/877] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:00.672290 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b38d6-1039-4161-86b3-9b0cf874a862 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:00.758527 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:00.770093 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b38d6-1039-4161-86b3-9b0cf874a862 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:00.803352 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5b961-b6c3-4218-84e0-f97d43902d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:00.803944 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5b961-b6c3-4218-84e0-f97d43902d71 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:00.804223 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5b961-b6c3-4218-84e0-f97d43902d71 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:00.804491 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5b961-b6c3-4218-84e0-f97d43902d71 None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:00.805148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5b961-b6c3-4218-84e0-f97d43902d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:00.805449 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5b961-b6c3-4218-84e0-f97d43902d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:00.806849 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5b961-b6c3-4218-84e0-f97d43902d71 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:00.817657 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 438/878] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:00.823362 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6288a65-5982-421d-ad6f-f331b8f0e4cb None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:00.925586 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6288a65-5982-421d-ad6f-f331b8f0e4cb None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:00.957878 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ad528-b21a-4d60-8dc2-19077c30e8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:00.958498 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ad528-b21a-4d60-8dc2-19077c30e8d8 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:00.958776 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ad528-b21a-4d60-8dc2-19077c30e8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:00.959045 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ad528-b21a-4d60-8dc2-19077c30e8d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:00.965413 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ad528-b21a-4d60-8dc2-19077c30e8d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:00.967456 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ad528-b21a-4d60-8dc2-19077c30e8d8 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-d05ad528-b21a-4d60-8dc2-19077c30e8d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:30:00.978278 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:00.979342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:00.980453 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:30:00.980453 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:30:00.980453 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:30:00.980453 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:30:00.980453 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:30:00.980453 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:30:00.980453 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:30:00.980453 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:00.980453 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 441/879] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:30:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:00.985912 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5b961-b6c3-4218-84e0-f97d43902d71 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:01.085333 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5b961-b6c3-4218-84e0-f97d43902d71 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:01.119394 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba51380-2b66-44ba-adb2-2757fd6563ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:01.119993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba51380-2b66-44ba-adb2-2757fd6563ec None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:01.120263 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba51380-2b66-44ba-adb2-2757fd6563ec None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:01.120529 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba51380-2b66-44ba-adb2-2757fd6563ec None admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:01.121376 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba51380-2b66-44ba-adb2-2757fd6563ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:01.121673 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba51380-2b66-44ba-adb2-2757fd6563ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:01.123106 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba51380-2b66-44ba-adb2-2757fd6563ec None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:01.134956 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 439/880] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:30:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:01.141806 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ad528-b21a-4d60-8dc2-19077c30e8d8 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:01.164548 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:01.257304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ad528-b21a-4d60-8dc2-19077c30e8d8 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:01.293324 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a271f-44a6-4cbe-9976-fb3e7f1898c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:01.293937 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a271f-44a6-4cbe-9976-fb3e7f1898c2 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:01.294212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a271f-44a6-4cbe-9976-fb3e7f1898c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:01.294479 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a271f-44a6-4cbe-9976-fb3e7f1898c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:01.295189 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a271f-44a6-4cbe-9976-fb3e7f1898c2 None admin] RBAC: Adding query filter params (role.id=17791940429e48ac98d4bd49aa53a88c, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=82313d212e4f454697849ea186208785) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:01.295493 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a271f-44a6-4cbe-9976-fb3e7f1898c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:01.296965 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a271f-44a6-4cbe-9976-fb3e7f1898c2 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:01.302398 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 442/881] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:30:01 2022] GET /identity/v3/role_assignments?user.id=82313d212e4f454697849ea186208785&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=17791940429e48ac98d4bd49aa53a88c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:03.499040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92347b-9658-47d0-afd2-b6e44332ba9f None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:03.499556 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92347b-9658-47d0-afd2-b6e44332ba9f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:03.499647 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92347b-9658-47d0-afd2-b6e44332ba9f None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:03.500965 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 440/882] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:30:03.506351 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccc8f2-2703-40d0-b00b-8bd55ff52784 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:03.506774 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccc8f2-2703-40d0-b00b-8bd55ff52784 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:03.506901 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccc8f2-2703-40d0-b00b-8bd55ff52784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:03.524609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-b0ccc8f2-2703-40d0-b00b-8bd55ff52784 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:30:03.525937 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-b0ccc8f2-2703-40d0-b00b-8bd55ff52784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:30:03.591145 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 443/883] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:30:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:30:03.915684 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92347b-9658-47d0-afd2-b6e44332ba9f None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:03.926959 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:04.016924 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92347b-9658-47d0-afd2-b6e44332ba9f None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:04.049475 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1559b-becd-49d8-b783-cbda35fa95e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:04.050093 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1559b-becd-49d8-b783-cbda35fa95e2 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:04.050370 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1559b-becd-49d8-b783-cbda35fa95e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:04.050639 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1559b-becd-49d8-b783-cbda35fa95e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:04.061099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1559b-becd-49d8-b783-cbda35fa95e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-93b1559b-becd-49d8-b783-cbda35fa95e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:30:04.066767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:04.070511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:30:04.071546 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 441/884] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:04.073906 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccc8f2-2703-40d0-b00b-8bd55ff52784 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:04.089077 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:04.171170 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccc8f2-2703-40d0-b00b-8bd55ff52784 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:04.205437 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e3bab-6aae-420c-b8f2-8cc503259631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:04.206032 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e3bab-6aae-420c-b8f2-8cc503259631 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:04.206305 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e3bab-6aae-420c-b8f2-8cc503259631 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:04.206570 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e3bab-6aae-420c-b8f2-8cc503259631 None admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:04.207218 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e3bab-6aae-420c-b8f2-8cc503259631 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:04.207510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e3bab-6aae-420c-b8f2-8cc503259631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:04.208890 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e3bab-6aae-420c-b8f2-8cc503259631 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:04.217419 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 444/885] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:30:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:04.223231 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1559b-becd-49d8-b783-cbda35fa95e2 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:04.291328 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:04.323627 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1559b-becd-49d8-b783-cbda35fa95e2 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:04.355628 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d10a-2a91-4578-a175-1fcf64951a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:04.356242 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d10a-2a91-4578-a175-1fcf64951a26 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:04.356520 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d10a-2a91-4578-a175-1fcf64951a26 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:04.356817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d10a-2a91-4578-a175-1fcf64951a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:04.366899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706d10a-2a91-4578-a175-1fcf64951a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:04.368333 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706d10a-2a91-4578-a175-1fcf64951a26 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-8706d10a-2a91-4578-a175-1fcf64951a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:30:04.384054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:04.388383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:30:04.389553 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:30:04.389553 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:30:04.389553 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:30:04.389553 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 442/886] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:04.391035 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e3bab-6aae-420c-b8f2-8cc503259631 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:04.469340 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:04.491330 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e3bab-6aae-420c-b8f2-8cc503259631 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:04.525740 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44637c80-ef60-452a-b2a6-e40e8906f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:04.525740 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44637c80-ef60-452a-b2a6-e40e8906f69b None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:04.525740 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44637c80-ef60-452a-b2a6-e40e8906f69b None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:04.525740 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44637c80-ef60-452a-b2a6-e40e8906f69b None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:04.526590 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44637c80-ef60-452a-b2a6-e40e8906f69b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:04.526590 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44637c80-ef60-452a-b2a6-e40e8906f69b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:04.527567 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44637c80-ef60-452a-b2a6-e40e8906f69b None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:04.544409 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 445/887] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:04.551321 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d10a-2a91-4578-a175-1fcf64951a26 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:04.650195 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d10a-2a91-4578-a175-1fcf64951a26 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:04.670356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:04.684151 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f6225-24c3-4dc9-839d-dd310ba91eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:04.684714 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f6225-24c3-4dc9-839d-dd310ba91eb6 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:04.685023 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f6225-24c3-4dc9-839d-dd310ba91eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:04.685300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f6225-24c3-4dc9-839d-dd310ba91eb6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:04.692647 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f6225-24c3-4dc9-839d-dd310ba91eb6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:04.693989 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f6225-24c3-4dc9-839d-dd310ba91eb6 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-957f6225-24c3-4dc9-839d-dd310ba91eb6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:30:04.704825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:04.705971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:04.707148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:04.707148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:04.707148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:30:04.707148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:30:04.707148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:30:04.707148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:30:04.707148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:30:04.707148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:30:04.707148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:30:04.707148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:30:04.707148 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 443/888] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:30:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:04.711844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44637c80-ef60-452a-b2a6-e40e8906f69b None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:04.810718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44637c80-ef60-452a-b2a6-e40e8906f69b None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:04.855838 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ac0af-a232-4e67-8f34-2466ed9a99ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:04.856436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ac0af-a232-4e67-8f34-2466ed9a99ec None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:04.856714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ac0af-a232-4e67-8f34-2466ed9a99ec None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:04.857014 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ac0af-a232-4e67-8f34-2466ed9a99ec None admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:04.858441 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ac0af-a232-4e67-8f34-2466ed9a99ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:04.858672 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ac0af-a232-4e67-8f34-2466ed9a99ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:04.861001 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ac0af-a232-4e67-8f34-2466ed9a99ec None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:04.862923 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:04.877651 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 446/889] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 19 17:30:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:04.883404 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f6225-24c3-4dc9-839d-dd310ba91eb6 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:04.981548 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f6225-24c3-4dc9-839d-dd310ba91eb6 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:05.013239 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a348ce8-2b9d-4160-ac0e-a2452612fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:05.014375 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a348ce8-2b9d-4160-ac0e-a2452612fd88 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:05.014650 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a348ce8-2b9d-4160-ac0e-a2452612fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:05.014918 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a348ce8-2b9d-4160-ac0e-a2452612fd88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:05.024973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a348ce8-2b9d-4160-ac0e-a2452612fd88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:05.026396 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a348ce8-2b9d-4160-ac0e-a2452612fd88 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-4a348ce8-2b9d-4160-ac0e-a2452612fd88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:30:05.040416 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:05.041574 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:30:05.042777 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:30:05.042777 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:30:05.042777 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:30:05.044876 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 444/890] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:05.047240 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ac0af-a232-4e67-8f34-2466ed9a99ec None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:05.146183 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ac0af-a232-4e67-8f34-2466ed9a99ec None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:05.179369 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02207-45d6-429f-8026-28d9a58c2eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:05.179964 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02207-45d6-429f-8026-28d9a58c2eea None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:05.180240 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02207-45d6-429f-8026-28d9a58c2eea None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:05.180510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02207-45d6-429f-8026-28d9a58c2eea None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:05.181174 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a02207-45d6-429f-8026-28d9a58c2eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:05.181475 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a02207-45d6-429f-8026-28d9a58c2eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:05.182829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a02207-45d6-429f-8026-28d9a58c2eea None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:05.194175 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 447/891] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:05.199858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a348ce8-2b9d-4160-ac0e-a2452612fd88 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:05.241349 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:05.312076 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a348ce8-2b9d-4160-ac0e-a2452612fd88 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:05.346208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd97fc8-cf88-4263-bd9b-493ec8ad1817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:05.346820 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd97fc8-cf88-4263-bd9b-493ec8ad1817 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:05.347092 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd97fc8-cf88-4263-bd9b-493ec8ad1817 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:05.347355 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd97fc8-cf88-4263-bd9b-493ec8ad1817 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:05.353699 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd97fc8-cf88-4263-bd9b-493ec8ad1817 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:05.355118 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd97fc8-cf88-4263-bd9b-493ec8ad1817 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-5bd97fc8-cf88-4263-bd9b-493ec8ad1817 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:30:05.365877 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:05.366952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:05.367851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:30:05.367851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:30:05.367851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:30:05.367851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:30:05.367851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:30:05.367851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:30:05.367851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:30:05.367851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:30:05.367851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 445/892] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:30:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:05.373455 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02207-45d6-429f-8026-28d9a58c2eea None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:05.427718 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:05.470981 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02207-45d6-429f-8026-28d9a58c2eea None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:05.504370 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357b0da-ffaa-4afe-b10f-16d3ccda4034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:05.505041 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357b0da-ffaa-4afe-b10f-16d3ccda4034 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:05.505331 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357b0da-ffaa-4afe-b10f-16d3ccda4034 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:05.505585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357b0da-ffaa-4afe-b10f-16d3ccda4034 None admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:05.506263 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357b0da-ffaa-4afe-b10f-16d3ccda4034 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:05.506561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357b0da-ffaa-4afe-b10f-16d3ccda4034 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:05.507966 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357b0da-ffaa-4afe-b10f-16d3ccda4034 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:05.521258 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 448/893] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:30:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:05.527398 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd97fc8-cf88-4263-bd9b-493ec8ad1817 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:05.616402 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:05.625251 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd97fc8-cf88-4263-bd9b-493ec8ad1817 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:05.657259 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6744f89-a40d-49b9-b91f-7eee4dcb3bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:05.657897 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6744f89-a40d-49b9-b91f-7eee4dcb3bbc None admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:05.658170 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6744f89-a40d-49b9-b91f-7eee4dcb3bbc None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:05.658438 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6744f89-a40d-49b9-b91f-7eee4dcb3bbc None admin] PATH_INFO: `/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/82313d212e4f454697849ea186208785/roles/17791940429e48ac98d4bd49aa53a88c` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:05.660271 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6744f89-a40d-49b9-b91f-7eee4dcb3bbc None admin] RBAC: Authorizing `identity:create_grant(project_id=8b84e7b6ac1644538bb6ef2874a1f0cf, user_id=82313d212e4f454697849ea186208785, role_id=17791940429e48ac98d4bd49aa53a88c)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:05.661718 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6744f89-a40d-49b9-b91f-7eee4dcb3bbc None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:05.790871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 446/894] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 19 17:30:05 2022] PUT /identity/v3/projects/8b84e7b6ac1644538bb6ef2874a1f0cf/users/82313d212e4f454697849ea186208785/roles/17791940429e48ac98d4bd49aa53a88c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:30:07.926262 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772bc06-7616-4be4-92cf-e5a116f12a1c None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:07.926828 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772bc06-7616-4be4-92cf-e5a116f12a1c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:07.926828 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772bc06-7616-4be4-92cf-e5a116f12a1c None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:07.928100 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 449/895] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:30:07.933163 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5dfb4-cde4-4528-b816-1cc3d8fbeef9 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:07.933609 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5dfb4-cde4-4528-b816-1cc3d8fbeef9 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:07.933707 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5dfb4-cde4-4528-b816-1cc3d8fbeef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:07.951971 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-28e5dfb4-cde4-4528-b816-1cc3d8fbeef9 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:30:07.953193 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-28e5dfb4-cde4-4528-b816-1cc3d8fbeef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:30:08.017548 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 447/896] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:30:07 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:30:08.342807 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772bc06-7616-4be4-92cf-e5a116f12a1c None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:08.442306 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772bc06-7616-4be4-92cf-e5a116f12a1c None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:08.456014 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:08.475287 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd572b71-be72-448b-8aba-08f0bed984c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:08.475904 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd572b71-be72-448b-8aba-08f0bed984c7 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:08.476179 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd572b71-be72-448b-8aba-08f0bed984c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:08.476445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd572b71-be72-448b-8aba-08f0bed984c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:08.486243 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd572b71-be72-448b-8aba-08f0bed984c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-bd572b71-be72-448b-8aba-08f0bed984c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:30:08.490914 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:08.494304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:08.495436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 450/897] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 19 17:30:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:08.498510 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5dfb4-cde4-4528-b816-1cc3d8fbeef9 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:08.583982 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:08.602547 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5dfb4-cde4-4528-b816-1cc3d8fbeef9 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:08.634628 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cfaac-18c4-409d-aa99-1f63682e3276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:08.635264 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cfaac-18c4-409d-aa99-1f63682e3276 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:08.635543 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cfaac-18c4-409d-aa99-1f63682e3276 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:08.635813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cfaac-18c4-409d-aa99-1f63682e3276 None admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:08.636467 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cfaac-18c4-409d-aa99-1f63682e3276 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:08.636795 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cfaac-18c4-409d-aa99-1f63682e3276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:08.638237 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cfaac-18c4-409d-aa99-1f63682e3276 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:08.646695 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 448/898] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 19 17:30:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:08.652760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd572b71-be72-448b-8aba-08f0bed984c7 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:08.751253 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd572b71-be72-448b-8aba-08f0bed984c7 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:08.783833 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc9967-d87c-46da-ae26-0742ff4b2a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:08.784442 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc9967-d87c-46da-ae26-0742ff4b2a45 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:08.784746 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc9967-d87c-46da-ae26-0742ff4b2a45 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:08.785012 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc9967-d87c-46da-ae26-0742ff4b2a45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:08.795337 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc9967-d87c-46da-ae26-0742ff4b2a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:08.796853 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc9967-d87c-46da-ae26-0742ff4b2a45 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-d4fc9967-d87c-46da-ae26-0742ff4b2a45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:30:08.811074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:08.812251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:30:08.815550 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:30:08.815550 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:30:08.815550 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:08.815550 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 451/899] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:30:08.818164 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cfaac-18c4-409d-aa99-1f63682e3276 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:08.925315 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cfaac-18c4-409d-aa99-1f63682e3276 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:08.957899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68c2fa-dfe7-4481-be4b-615daa9eafbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:08.958488 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68c2fa-dfe7-4481-be4b-615daa9eafbd None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:08.958755 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68c2fa-dfe7-4481-be4b-615daa9eafbd None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:08.959022 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68c2fa-dfe7-4481-be4b-615daa9eafbd None admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:08.959648 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68c2fa-dfe7-4481-be4b-615daa9eafbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:08.959948 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68c2fa-dfe7-4481-be4b-615daa9eafbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:08.961365 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68c2fa-dfe7-4481-be4b-615daa9eafbd None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:08.973201 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 449/900] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:08.979090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc9967-d87c-46da-ae26-0742ff4b2a45 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:09.005993 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:09.075003 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc9967-d87c-46da-ae26-0742ff4b2a45 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:09.109110 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511d32e-59d4-4a9d-9447-911e51a83bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:09.109717 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511d32e-59d4-4a9d-9447-911e51a83bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:09.109992 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511d32e-59d4-4a9d-9447-911e51a83bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:09.110259 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511d32e-59d4-4a9d-9447-911e51a83bc1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:09.117129 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511d32e-59d4-4a9d-9447-911e51a83bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:09.118583 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511d32e-59d4-4a9d-9447-911e51a83bc1 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-8511d32e-59d4-4a9d-9447-911e51a83bc1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:30:09.130506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:09.132428 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:09.133640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:09.133640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:09.133640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:30:09.133640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:30:09.133640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:30:09.133640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:30:09.133640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:30:09.133640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:30:09.133640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:30:09.133640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:09.133640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 452/901] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:30:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:30:09.138092 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68c2fa-dfe7-4481-be4b-615daa9eafbd None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:09.143350 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:09.236130 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68c2fa-dfe7-4481-be4b-615daa9eafbd None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:09.272055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24db3b-4737-4149-bc80-e273c48976fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:09.272646 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24db3b-4737-4149-bc80-e273c48976fc None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:09.272949 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24db3b-4737-4149-bc80-e273c48976fc None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:09.273218 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24db3b-4737-4149-bc80-e273c48976fc None admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:09.273931 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24db3b-4737-4149-bc80-e273c48976fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:09.274273 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24db3b-4737-4149-bc80-e273c48976fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:09.275712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24db3b-4737-4149-bc80-e273c48976fc None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:09.292668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 450/902] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 19 17:30:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:09.298691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511d32e-59d4-4a9d-9447-911e51a83bc1 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:09.383343 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:09.398122 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511d32e-59d4-4a9d-9447-911e51a83bc1 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:09.430909 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c792d7-7267-4da2-8957-7c3d6b94a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:09.431507 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c792d7-7267-4da2-8957-7c3d6b94a0e6 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:09.431781 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c792d7-7267-4da2-8957-7c3d6b94a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:09.432051 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c792d7-7267-4da2-8957-7c3d6b94a0e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:09.500056 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c792d7-7267-4da2-8957-7c3d6b94a0e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:09.501621 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c792d7-7267-4da2-8957-7c3d6b94a0e6 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:09.581824 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:09.596381 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 453/903] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 19 17:30:09 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 17:30:09.602369 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24db3b-4737-4149-bc80-e273c48976fc None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:09.662991 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:09.700836 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24db3b-4737-4149-bc80-e273c48976fc None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:09.734580 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31b6b6-3ddb-4f00-9ca2-94bf7b48e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:09.735221 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31b6b6-3ddb-4f00-9ca2-94bf7b48e946 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:09.735502 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31b6b6-3ddb-4f00-9ca2-94bf7b48e946 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:09.735774 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31b6b6-3ddb-4f00-9ca2-94bf7b48e946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:09.745536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31b6b6-3ddb-4f00-9ca2-94bf7b48e946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:09.746967 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31b6b6-3ddb-4f00-9ca2-94bf7b48e946 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-1e31b6b6-3ddb-4f00-9ca2-94bf7b48e946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:30:09.761605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:09.762861 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:30:09.763964 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:30:09.763964 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:30:09.763964 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:30:09.763964 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 451/904] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:09.768607 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c792d7-7267-4da2-8957-7c3d6b94a0e6 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:09.867025 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c792d7-7267-4da2-8957-7c3d6b94a0e6 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:09.899671 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01eeecb-3430-4d94-bed6-ed1bc096e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:09.900266 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01eeecb-3430-4d94-bed6-ed1bc096e445 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:09.900543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01eeecb-3430-4d94-bed6-ed1bc096e445 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:09.900841 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01eeecb-3430-4d94-bed6-ed1bc096e445 None admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:09.901569 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01eeecb-3430-4d94-bed6-ed1bc096e445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:09.901875 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01eeecb-3430-4d94-bed6-ed1bc096e445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:09.903227 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01eeecb-3430-4d94-bed6-ed1bc096e445 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:09.914920 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 454/905] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 19 17:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:09.921281 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31b6b6-3ddb-4f00-9ca2-94bf7b48e946 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:10.018346 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31b6b6-3ddb-4f00-9ca2-94bf7b48e946 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:10.032095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:10.051867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456768bd-386f-48f1-b60c-f3658555a22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:10.052549 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456768bd-386f-48f1-b60c-f3658555a22c None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:10.052846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456768bd-386f-48f1-b60c-f3658555a22c None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:10.053116 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456768bd-386f-48f1-b60c-f3658555a22c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:10.059532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456768bd-386f-48f1-b60c-f3658555a22c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:10.061064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456768bd-386f-48f1-b60c-f3658555a22c None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application [None req-456768bd-386f-48f1-b60c-f3658555a22c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:30:10.071768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:10.072846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:10.074099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:30:10.074099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:30:10.074099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:30:10.074099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:30:10.074099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:30:10.074099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:30:10.074099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:30:10.074099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: ERROR keystone.server.flask.application Aug 19 17:30:10.074099 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 452/906] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 19 17:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:10.078766 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01eeecb-3430-4d94-bed6-ed1bc096e445 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:10.124933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:10.181478 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01eeecb-3430-4d94-bed6-ed1bc096e445 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:10.214371 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e054d26-df2a-460a-821f-b86f8c72d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:10.214964 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e054d26-df2a-460a-821f-b86f8c72d5be None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:10.215242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e054d26-df2a-460a-821f-b86f8c72d5be None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:10.215518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e054d26-df2a-460a-821f-b86f8c72d5be None admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:10.216196 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e054d26-df2a-460a-821f-b86f8c72d5be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:10.217133 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e054d26-df2a-460a-821f-b86f8c72d5be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:10.218573 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e054d26-df2a-460a-821f-b86f8c72d5be None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:10.230114 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 455/907] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 19 17:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:10.236315 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456768bd-386f-48f1-b60c-f3658555a22c None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:10.336650 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456768bd-386f-48f1-b60c-f3658555a22c None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:10.373902 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16c9fb-7685-44ed-abc0-bc941d1d2c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:10.374493 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16c9fb-7685-44ed-abc0-bc941d1d2c0c None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:10.374767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16c9fb-7685-44ed-abc0-bc941d1d2c0c None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:10.375033 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16c9fb-7685-44ed-abc0-bc941d1d2c0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:10.375735 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16c9fb-7685-44ed-abc0-bc941d1d2c0c None admin] RBAC: Adding query filter params (role.id=17791940429e48ac98d4bd49aa53a88c, scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf, user.id=82313d212e4f454697849ea186208785) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:10.376039 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16c9fb-7685-44ed-abc0-bc941d1d2c0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:10.377482 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16c9fb-7685-44ed-abc0-bc941d1d2c0c None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:10.383029 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 453/908] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 19 17:30:10 2022] GET /identity/v3/role_assignments?user.id=82313d212e4f454697849ea186208785&scope.project.id=8b84e7b6ac1644538bb6ef2874a1f0cf&role.id=17791940429e48ac98d4bd49aa53a88c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:12.617654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b59372-68d4-4fa5-ae08-c43c4e3cdc9c None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:12.618244 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b59372-68d4-4fa5-ae08-c43c4e3cdc9c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:12.618244 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b59372-68d4-4fa5-ae08-c43c4e3cdc9c None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:12.619490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 456/909] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:30:12.625144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a11ce7-88c7-4a85-ac5c-8a4173c92b2b None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:12.625566 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a11ce7-88c7-4a85-ac5c-8a4173c92b2b None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:12.625703 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a11ce7-88c7-4a85-ac5c-8a4173c92b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:12.643270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-40a11ce7-88c7-4a85-ac5c-8a4173c92b2b None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:30:12.644452 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-40a11ce7-88c7-4a85-ac5c-8a4173c92b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:30:12.673847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:12.710399 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 454/910] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:30:12 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:30:13.033598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b59372-68d4-4fa5-ae08-c43c4e3cdc9c None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:13.132339 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b59372-68d4-4fa5-ae08-c43c4e3cdc9c None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:13.140016 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:13.165619 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a20da1-6da7-45fb-b201-572c4fb69162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:13.166228 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a20da1-6da7-45fb-b201-572c4fb69162 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:13.166504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a20da1-6da7-45fb-b201-572c4fb69162 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:13.166770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a20da1-6da7-45fb-b201-572c4fb69162 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:13.167340 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a20da1-6da7-45fb-b201-572c4fb69162 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:13.168678 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a20da1-6da7-45fb-b201-572c4fb69162 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-c2a20da1-6da7-45fb-b201-572c4fb69162 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:13.177208 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:13.184422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:13.185543 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 457/911] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 19 17:30:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:13.186563 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a11ce7-88c7-4a85-ac5c-8a4173c92b2b None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:13.291046 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a11ce7-88c7-4a85-ac5c-8a4173c92b2b None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:13.325523 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba799a-406a-4c61-92c7-22f97ec9de2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:13.326131 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba799a-406a-4c61-92c7-22f97ec9de2c None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:13.326414 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba799a-406a-4c61-92c7-22f97ec9de2c None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:13.326683 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba799a-406a-4c61-92c7-22f97ec9de2c None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:13.327303 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba799a-406a-4c61-92c7-22f97ec9de2c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:13.327599 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba799a-406a-4c61-92c7-22f97ec9de2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:13.328984 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba799a-406a-4c61-92c7-22f97ec9de2c None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:13.333520 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 455/912] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Aug 19 17:30:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:30:13.339347 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a20da1-6da7-45fb-b201-572c4fb69162 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:13.438953 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a20da1-6da7-45fb-b201-572c4fb69162 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:13.471220 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab0732-f980-455c-b990-c5ee30d9331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:13.471839 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab0732-f980-455c-b990-c5ee30d9331a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:13.472118 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab0732-f980-455c-b990-c5ee30d9331a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:13.472388 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab0732-f980-455c-b990-c5ee30d9331a None admin] PATH_INFO: `/v3/services` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:13.473033 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab0732-f980-455c-b990-c5ee30d9331a None admin] RBAC: Adding query filter params (type=placement) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:13.473339 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab0732-f980-455c-b990-c5ee30d9331a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:13.474683 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab0732-f980-455c-b990-c5ee30d9331a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:13.478909 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 458/913] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Aug 19 17:30:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:15.628088 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5b7b8-31b4-403e-a369-dc07e004e2c9 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:15.628652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5b7b8-31b4-403e-a369-dc07e004e2c9 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:15.628652 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5b7b8-31b4-403e-a369-dc07e004e2c9 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:15.630121 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 456/914] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:30:15.636099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94fe5e-4458-43e1-9e70-fd2eddcdbb66 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:15.636647 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94fe5e-4458-43e1-9e70-fd2eddcdbb66 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:15.636920 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94fe5e-4458-43e1-9e70-fd2eddcdbb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:15.655618 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-ca94fe5e-4458-43e1-9e70-fd2eddcdbb66 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:30:15.656801 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-ca94fe5e-4458-43e1-9e70-fd2eddcdbb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:30:15.687060 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:15.721929 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 459/915] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:30:15 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:30:16.045727 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5b7b8-31b4-403e-a369-dc07e004e2c9 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:16.078033 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:16.146614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5b7b8-31b4-403e-a369-dc07e004e2c9 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:16.179964 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cbcc2-40b4-4c5d-a8cb-c201037a48d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:16.180550 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cbcc2-40b4-4c5d-a8cb-c201037a48d1 None admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:16.180858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cbcc2-40b4-4c5d-a8cb-c201037a48d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:16.181132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cbcc2-40b4-4c5d-a8cb-c201037a48d1 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:16.181772 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cbcc2-40b4-4c5d-a8cb-c201037a48d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:16.183168 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cbcc2-40b4-4c5d-a8cb-c201037a48d1 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:16.270286 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 457/916] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 19 17:30:16 2022] POST /identity/v3/services => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:30:18.456224 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e6654-bc33-4dcc-a671-045e72bd1245 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:18.456714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e6654-bc33-4dcc-a671-045e72bd1245 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:18.456867 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e6654-bc33-4dcc-a671-045e72bd1245 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:18.458099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 460/917] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:30:18.463385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcd7cd-5441-474c-8fd2-140e3f097df8 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:18.463820 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcd7cd-5441-474c-8fd2-140e3f097df8 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:18.463916 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcd7cd-5441-474c-8fd2-140e3f097df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:18.482538 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-01bcd7cd-5441-474c-8fd2-140e3f097df8 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:30:18.483712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-01bcd7cd-5441-474c-8fd2-140e3f097df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:30:18.555660 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 458/918] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:30:18 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:30:18.892400 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e6654-bc33-4dcc-a671-045e72bd1245 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:18.989695 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e6654-bc33-4dcc-a671-045e72bd1245 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:19.023018 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fd3c3-722b-492d-8e8c-8d2efa6aba4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:19.023639 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fd3c3-722b-492d-8e8c-8d2efa6aba4a None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:19.023954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fd3c3-722b-492d-8e8c-8d2efa6aba4a None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:19.024221 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fd3c3-722b-492d-8e8c-8d2efa6aba4a None admin] PATH_INFO: `/v3/services/placement` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:19.024820 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fd3c3-722b-492d-8e8c-8d2efa6aba4a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:19.026180 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fd3c3-722b-492d-8e8c-8d2efa6aba4a None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-1f2fd3c3-722b-492d-8e8c-8d2efa6aba4a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:19.034598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:19.035770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:19.036919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 461/919] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 19 17:30:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:19.041780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcd7cd-5441-474c-8fd2-140e3f097df8 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:19.059907 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:19.137044 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcd7cd-5441-474c-8fd2-140e3f097df8 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:19.168961 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa8074-63b2-4c3c-867f-784d87ce6e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:19.169544 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa8074-63b2-4c3c-867f-784d87ce6e36 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:19.170338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa8074-63b2-4c3c-867f-784d87ce6e36 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:19.170605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa8074-63b2-4c3c-867f-784d87ce6e36 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:19.171215 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa8074-63b2-4c3c-867f-784d87ce6e36 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:19.171508 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa8074-63b2-4c3c-867f-784d87ce6e36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:19.172876 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa8074-63b2-4c3c-867f-784d87ce6e36 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:19.178249 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 459/920] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Aug 19 17:30:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:19.183871 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fd3c3-722b-492d-8e8c-8d2efa6aba4a None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:19.211528 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:19.278268 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fd3c3-722b-492d-8e8c-8d2efa6aba4a None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:19.320097 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b23896-a12b-4f95-9845-3ba4dc5cc04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:19.320697 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b23896-a12b-4f95-9845-3ba4dc5cc04c None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:19.321026 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b23896-a12b-4f95-9845-3ba4dc5cc04c None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:19.321292 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b23896-a12b-4f95-9845-3ba4dc5cc04c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:19.321979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b23896-a12b-4f95-9845-3ba4dc5cc04c None admin] RBAC: Adding query filter params (interface=public, service_id=996ac157e5fc4f1aaa991bba7f9ded27, region_id=RegionOne) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:19.322283 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b23896-a12b-4f95-9845-3ba4dc5cc04c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:19.323636 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b23896-a12b-4f95-9845-3ba4dc5cc04c None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:19.329186 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 462/921] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 19 17:30:19 2022] GET /identity/v3/endpoints?service_id=996ac157e5fc4f1aaa991bba7f9ded27&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:19.335034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa8074-63b2-4c3c-867f-784d87ce6e36 None admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:19.414781 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:19.433116 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa8074-63b2-4c3c-867f-784d87ce6e36 None admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:19.465891 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8e350-3b5a-4282-979f-2132d3af3363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:19.466509 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8e350-3b5a-4282-979f-2132d3af3363 None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:19.466817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8e350-3b5a-4282-979f-2132d3af3363 None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:19.467091 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8e350-3b5a-4282-979f-2132d3af3363 None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:19.467685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8e350-3b5a-4282-979f-2132d3af3363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:19.469073 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8e350-3b5a-4282-979f-2132d3af3363 None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:19.475743 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 460/922] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 19 17:30:19 2022] GET /identity/v3/services => generated 1962 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:30:21.658212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503d60-fab6-4b46-a1dc-f5f71c3f2257 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:21.658759 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503d60-fab6-4b46-a1dc-f5f71c3f2257 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:21.658759 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503d60-fab6-4b46-a1dc-f5f71c3f2257 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:21.660055 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 463/923] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:30:21.665483 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bf500-376f-4f2d-9cf9-d1eb79a30cd2 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:21.665893 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bf500-376f-4f2d-9cf9-d1eb79a30cd2 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:21.666005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bf500-376f-4f2d-9cf9-d1eb79a30cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:21.684528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-896bf500-376f-4f2d-9cf9-d1eb79a30cd2 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:30:21.686246 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-896bf500-376f-4f2d-9cf9-d1eb79a30cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:30:21.750706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 461/924] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:30:21 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:30:22.083555 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca503d60-fab6-4b46-a1dc-f5f71c3f2257 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:22.174797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:22.183988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca503d60-fab6-4b46-a1dc-f5f71c3f2257 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:22.216431 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6fadf-742c-4542-8fad-12efc50c8962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:22.217609 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6fadf-742c-4542-8fad-12efc50c8962 None admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:22.217930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6fadf-742c-4542-8fad-12efc50c8962 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:22.218205 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6fadf-742c-4542-8fad-12efc50c8962 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:22.218774 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6fadf-742c-4542-8fad-12efc50c8962 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:22.220171 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6fadf-742c-4542-8fad-12efc50c8962 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application [None req-00e6fadf-742c-4542-8fad-12efc50c8962 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:30:22.228510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:30:22.229701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application with Lock( Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: ERROR keystone.server.flask.application Aug 19 17:30:22.230834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 464/925] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 19 17:30:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:30:22.235695 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bf500-376f-4f2d-9cf9-d1eb79a30cd2 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:22.309213 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:22.331435 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bf500-376f-4f2d-9cf9-d1eb79a30cd2 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:22.363999 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67201aa-8855-4b14-83ea-e1248019890e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:22.364525 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67201aa-8855-4b14-83ea-e1248019890e None admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:22.364834 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67201aa-8855-4b14-83ea-e1248019890e None admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:22.365107 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67201aa-8855-4b14-83ea-e1248019890e None admin] PATH_INFO: `/v3/services` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:22.365723 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67201aa-8855-4b14-83ea-e1248019890e None admin] RBAC: Adding query filter params (name=placement) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:30:22.366026 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67201aa-8855-4b14-83ea-e1248019890e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:22.367379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67201aa-8855-4b14-83ea-e1248019890e None admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:22.372329 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 462/926] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Aug 19 17:30:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:30:22.378066 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6fadf-742c-4542-8fad-12efc50c8962 None admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:30:22.476349 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6fadf-742c-4542-8fad-12efc50c8962 None admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:30:22.508749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10f688-f2b0-422c-bed3-479373862451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:30:22.509471 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10f688-f2b0-422c-bed3-479373862451 None admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:30:22.509758 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10f688-f2b0-422c-bed3-479373862451 None admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:30:22.510025 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10f688-f2b0-422c-bed3-479373862451 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:30:22.510676 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10f688-f2b0-422c-bed3-479373862451 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:30:22.512029 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10f688-f2b0-422c-bed3-479373862451 None admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:30:22.654013 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 465/927] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 19 17:30:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:30:32.442321 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=30 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:30:32.649276 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:36:57.559464 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef5fb7-716f-406e-a2ac-d9012ef4040b None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:36:57.559988 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef5fb7-716f-406e-a2ac-d9012ef4040b None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:36:57.559988 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef5fb7-716f-406e-a2ac-d9012ef4040b None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:36:57.561644 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 463/928] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:36:57.566597 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44419c-c40d-44b5-9021-70abc9da5816 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:36:57.567052 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44419c-c40d-44b5-9021-70abc9da5816 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:36:57.567150 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44419c-c40d-44b5-9021-70abc9da5816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:36:57.703192 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-9c44419c-c40d-44b5-9021-70abc9da5816 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:36:57.704497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-9c44419c-c40d-44b5-9021-70abc9da5816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:36:57.829548 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 466/929] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:36:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:36:58.195016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9175a-a889-48c1-b5c4-058e46fd52f2 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:36:58.195315 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9175a-a889-48c1-b5c4-058e46fd52f2 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:36:58.195583 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9175a-a889-48c1-b5c4-058e46fd52f2 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:36:58.197237 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 464/930] 10.222.0.27 () {54 vars in 965 bytes} [Fri Aug 19 17:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:36:58.205694 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8f0aa-d1b8-41ab-962c-c148e595d12f None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:36:58.206050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8f0aa-d1b8-41ab-962c-c148e595d12f None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:36:58.206389 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8f0aa-d1b8-41ab-962c-c148e595d12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:36:58.262007 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-dee8f0aa-d1b8-41ab-962c-c148e595d12f None None] MFA Rules not processed for user `f21c562918c04d18aa0b01a3bdd4d6af`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:36:58.263228 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-dee8f0aa-d1b8-41ab-962c-c148e595d12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:36:58.303087 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:36:58.339349 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 467/931] 10.222.0.27 () {58 vars in 1062 bytes} [Fri Aug 19 17:36:58 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:36:58.348558 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9175a-a889-48c1-b5c4-058e46fd52f2 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:36:58.360230 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9175a-a889-48c1-b5c4-058e46fd52f2 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:36:58.363985 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c5fe-500b-4acf-9f70-e7ded1c88f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:36:58.364599 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c5fe-500b-4acf-9f70-e7ded1c88f42 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:36:58.364915 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c5fe-500b-4acf-9f70-e7ded1c88f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:36:58.365189 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c5fe-500b-4acf-9f70-e7ded1c88f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:36:58.375647 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535c5fe-500b-4acf-9f70-e7ded1c88f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:36:58.377134 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535c5fe-500b-4acf-9f70-e7ded1c88f42 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:36:58.387777 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 465/932] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:36:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:00.858509 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e0fa3-12d7-4e67-b33a-683b72d64633 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:00.859013 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e0fa3-12d7-4e67-b33a-683b72d64633 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:00.859013 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e0fa3-12d7-4e67-b33a-683b72d64633 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:00.860280 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 468/933] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:00.865499 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5305dc-86f5-4de9-a5ca-80150e8de4be None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:00.865946 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5305dc-86f5-4de9-a5ca-80150e8de4be None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:00.866047 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5305dc-86f5-4de9-a5ca-80150e8de4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:00.885307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-9b5305dc-86f5-4de9-a5ca-80150e8de4be None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:00.886823 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-9b5305dc-86f5-4de9-a5ca-80150e8de4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:00.896024 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 466/934] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:01.240531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e0fa3-12d7-4e67-b33a-683b72d64633 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:01.251493 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e0fa3-12d7-4e67-b33a-683b72d64633 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:01.254844 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7c6db-8dd9-4cc1-a9f6-fbf6c3829d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:01.255427 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7c6db-8dd9-4cc1-a9f6-fbf6c3829d75 service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:01.255700 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7c6db-8dd9-4cc1-a9f6-fbf6c3829d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:01.255969 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7c6db-8dd9-4cc1-a9f6-fbf6c3829d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:01.265319 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7c6db-8dd9-4cc1-a9f6-fbf6c3829d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:01.266732 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7c6db-8dd9-4cc1-a9f6-fbf6c3829d75 service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:01.275750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 469/935] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:04.050678 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a45b2f-b919-4ec7-b883-b75cb6cfb279 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:04.051229 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a45b2f-b919-4ec7-b883-b75cb6cfb279 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:04.051229 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a45b2f-b919-4ec7-b883-b75cb6cfb279 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:04.052701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 467/936] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:04.058359 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299896d0-eb6c-4c1c-a519-441a524d198a None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:04.058760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299896d0-eb6c-4c1c-a519-441a524d198a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:04.058997 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299896d0-eb6c-4c1c-a519-441a524d198a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:04.121499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-299896d0-eb6c-4c1c-a519-441a524d198a None None] MFA Rules not processed for user `764bfa213b604c20a8badf2dcbdd4fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:04.123200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-299896d0-eb6c-4c1c-a519-441a524d198a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:04.212173 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 470/937] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:04 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:04.572521 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1e235-6337-4fc8-86fa-983b6a4c0d7d None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:04.572847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1e235-6337-4fc8-86fa-983b6a4c0d7d None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:04.573278 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1e235-6337-4fc8-86fa-983b6a4c0d7d None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:04.574892 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 468/938] 10.222.0.27 () {54 vars in 965 bytes} [Fri Aug 19 17:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:04.581711 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9763da-3cf3-408f-b675-6e18b2676bc2 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:04.582088 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9763da-3cf3-408f-b675-6e18b2676bc2 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:04.582356 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9763da-3cf3-408f-b675-6e18b2676bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:04.603967 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-4d9763da-3cf3-408f-b675-6e18b2676bc2 None None] MFA Rules not processed for user `f21c562918c04d18aa0b01a3bdd4d6af`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:04.605216 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-4d9763da-3cf3-408f-b675-6e18b2676bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:04.612488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 471/939] 10.222.0.27 () {58 vars in 1062 bytes} [Fri Aug 19 17:37:04 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:04.621872 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1e235-6337-4fc8-86fa-983b6a4c0d7d None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:04.633836 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1e235-6337-4fc8-86fa-983b6a4c0d7d None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:04.637378 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4473a-e8c3-46d4-9050-c90199c1e006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:04.638068 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4473a-e8c3-46d4-9050-c90199c1e006 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:04.638473 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4473a-e8c3-46d4-9050-c90199c1e006 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:04.638804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4473a-e8c3-46d4-9050-c90199c1e006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:04.650146 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4473a-e8c3-46d4-9050-c90199c1e006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:04.651845 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4473a-e8c3-46d4-9050-c90199c1e006 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:04.664963 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 469/940] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:04 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:08.043004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdae78-504d-420b-8776-e8f62db26d22 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:08.043504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdae78-504d-420b-8776-e8f62db26d22 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:08.043504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdae78-504d-420b-8776-e8f62db26d22 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:08.045435 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 472/941] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:08.050805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bb7aa-30c1-49ac-991e-2b2934386be8 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:08.051432 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bb7aa-30c1-49ac-991e-2b2934386be8 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:08.051432 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bb7aa-30c1-49ac-991e-2b2934386be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:08.071358 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-301bb7aa-30c1-49ac-991e-2b2934386be8 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:08.072586 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-301bb7aa-30c1-49ac-991e-2b2934386be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:08.137013 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 470/942] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:08 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:08.480849 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdae78-504d-420b-8776-e8f62db26d22 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:08.491195 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdae78-504d-420b-8776-e8f62db26d22 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:08.494608 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f316c4-f95d-48c9-b506-568fa22732fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:08.495190 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f316c4-f95d-48c9-b506-568fa22732fa service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:08.495466 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f316c4-f95d-48c9-b506-568fa22732fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:08.495733 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f316c4-f95d-48c9-b506-568fa22732fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:08.504176 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f316c4-f95d-48c9-b506-568fa22732fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:08.505632 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f316c4-f95d-48c9-b506-568fa22732fa service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:08.515988 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 473/943] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:08 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:11.750641 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcc429-478e-41f1-a6da-3455e08dc940 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:11.751153 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcc429-478e-41f1-a6da-3455e08dc940 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:11.751153 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcc429-478e-41f1-a6da-3455e08dc940 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:11.752409 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 471/944] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:11.757552 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37a81a-030a-4d59-b0a7-a4c6ad170d0a None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:11.757954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37a81a-030a-4d59-b0a7-a4c6ad170d0a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:11.758089 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37a81a-030a-4d59-b0a7-a4c6ad170d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:11.777319 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-4f37a81a-030a-4d59-b0a7-a4c6ad170d0a None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:11.778496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-4f37a81a-030a-4d59-b0a7-a4c6ad170d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:11.786220 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 474/945] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:12.120461 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcc429-478e-41f1-a6da-3455e08dc940 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:12.131271 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcc429-478e-41f1-a6da-3455e08dc940 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:12.134642 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693ef92-b9ef-4e8c-b44c-5b6e96545c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:12.135218 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693ef92-b9ef-4e8c-b44c-5b6e96545c98 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:12.135492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693ef92-b9ef-4e8c-b44c-5b6e96545c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:12.135758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693ef92-b9ef-4e8c-b44c-5b6e96545c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:12.144145 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693ef92-b9ef-4e8c-b44c-5b6e96545c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:12.145599 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693ef92-b9ef-4e8c-b44c-5b6e96545c98 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:12.154548 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 472/946] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:14.407925 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701765ad-f239-40b2-aa88-1d4243dc02f4 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:14.408424 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701765ad-f239-40b2-aa88-1d4243dc02f4 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:14.408424 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701765ad-f239-40b2-aa88-1d4243dc02f4 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:14.409721 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 475/947] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:14.414846 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ca10-8d98-4573-a91d-b3ad4251021d None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:14.415275 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ca10-8d98-4573-a91d-b3ad4251021d None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:14.415474 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ca10-8d98-4573-a91d-b3ad4251021d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:14.435904 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-3bb0ca10-8d98-4573-a91d-b3ad4251021d None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:14.437142 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-3bb0ca10-8d98-4573-a91d-b3ad4251021d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:14.444730 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 473/948] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:14.791121 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701765ad-f239-40b2-aa88-1d4243dc02f4 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:14.808102 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701765ad-f239-40b2-aa88-1d4243dc02f4 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:14.811594 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef95eb-15bc-425c-a2de-15c278bf4a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:14.812188 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef95eb-15bc-425c-a2de-15c278bf4a3e service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:14.812460 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef95eb-15bc-425c-a2de-15c278bf4a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:14.812735 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef95eb-15bc-425c-a2de-15c278bf4a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:14.821991 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef95eb-15bc-425c-a2de-15c278bf4a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:14.824016 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef95eb-15bc-425c-a2de-15c278bf4a3e service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:14.834653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 476/949] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:17.124774 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2ccb1-b40e-4309-82b5-5dada7148daa None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:17.125354 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2ccb1-b40e-4309-82b5-5dada7148daa None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:17.125354 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2ccb1-b40e-4309-82b5-5dada7148daa None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:17.126633 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 474/950] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:17.131612 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8984863-78c1-4afa-af10-2da947933554 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:17.132101 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8984863-78c1-4afa-af10-2da947933554 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:17.132200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8984863-78c1-4afa-af10-2da947933554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:17.150809 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-a8984863-78c1-4afa-af10-2da947933554 None None] MFA Rules not processed for user `764bfa213b604c20a8badf2dcbdd4fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:17.151916 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-a8984863-78c1-4afa-af10-2da947933554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:17.159936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 477/951] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:17 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:17.500362 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2ccb1-b40e-4309-82b5-5dada7148daa None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:17.510975 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2ccb1-b40e-4309-82b5-5dada7148daa None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:17.515123 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0680d-2e49-4e89-92dd-3933d5fdf029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:17.515581 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0680d-2e49-4e89-92dd-3933d5fdf029 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:17.515854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0680d-2e49-4e89-92dd-3933d5fdf029 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:17.516127 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0680d-2e49-4e89-92dd-3933d5fdf029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:17.524880 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0680d-2e49-4e89-92dd-3933d5fdf029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:17.526206 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0680d-2e49-4e89-92dd-3933d5fdf029 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:17.536354 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 475/952] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:17 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:20.397568 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97394ff0-5311-422a-97b4-210fd6abaf61 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:20.398145 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97394ff0-5311-422a-97b4-210fd6abaf61 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:20.398145 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97394ff0-5311-422a-97b4-210fd6abaf61 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:20.399685 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 478/953] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:37:20.405750 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a41530-c476-4d00-8729-ab9de6c1804c None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:20.406230 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a41530-c476-4d00-8729-ab9de6c1804c None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:20.406333 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a41530-c476-4d00-8729-ab9de6c1804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:20.426650 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-c0a41530-c476-4d00-8729-ab9de6c1804c None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:20.427841 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-c0a41530-c476-4d00-8729-ab9de6c1804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:20.435865 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 476/954] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:20.785902 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97394ff0-5311-422a-97b4-210fd6abaf61 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:20.798350 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97394ff0-5311-422a-97b4-210fd6abaf61 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:20.803024 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913921b2-620b-48ad-8a86-adb03225c8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:20.803753 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913921b2-620b-48ad-8a86-adb03225c8fe service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:20.804030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913921b2-620b-48ad-8a86-adb03225c8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:20.804295 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913921b2-620b-48ad-8a86-adb03225c8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:20.814956 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913921b2-620b-48ad-8a86-adb03225c8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:20.816427 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913921b2-620b-48ad-8a86-adb03225c8fe service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:20.826769 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 479/955] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:23.095461 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841da66-4b86-4e9c-8c47-2aa24332cbb2 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:23.096027 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841da66-4b86-4e9c-8c47-2aa24332cbb2 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:23.096027 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841da66-4b86-4e9c-8c47-2aa24332cbb2 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:23.097365 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 477/956] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:23.102546 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a1168-683b-44e4-bb5d-f7a0725ebe35 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:23.102991 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a1168-683b-44e4-bb5d-f7a0725ebe35 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:23.103078 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a1168-683b-44e4-bb5d-f7a0725ebe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:23.111229 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:37:23.123095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-8a3a1168-683b-44e4-bb5d-f7a0725ebe35 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:23.124367 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-8a3a1168-683b-44e4-bb5d-f7a0725ebe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:23.132265 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 480/957] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:23.477069 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841da66-4b86-4e9c-8c47-2aa24332cbb2 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:23.482859 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=65 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:37:23.488525 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841da66-4b86-4e9c-8c47-2aa24332cbb2 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:23.491899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2934fd3-d045-43fd-9253-01787bedd2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:23.492468 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934fd3-d045-43fd-9253-01787bedd2eb service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:23.492762 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934fd3-d045-43fd-9253-01787bedd2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:23.493033 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2934fd3-d045-43fd-9253-01787bedd2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:23.502296 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2934fd3-d045-43fd-9253-01787bedd2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:23.503696 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2934fd3-d045-43fd-9253-01787bedd2eb service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:23.512780 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 478/958] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:26.550079 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cc5b0-01a1-48dc-b34d-adbe5de48512 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:26.550595 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cc5b0-01a1-48dc-b34d-adbe5de48512 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:26.550683 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cc5b0-01a1-48dc-b34d-adbe5de48512 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:26.551912 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 481/959] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:26.557163 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01a53-267e-473d-8e05-1037779002ac None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:26.557568 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01a53-267e-473d-8e05-1037779002ac None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:26.557706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01a53-267e-473d-8e05-1037779002ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:26.576807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-2df01a53-267e-473d-8e05-1037779002ac None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:26.577986 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-2df01a53-267e-473d-8e05-1037779002ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:26.585547 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 479/960] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:26 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:26.923362 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cc5b0-01a1-48dc-b34d-adbe5de48512 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:26.934004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cc5b0-01a1-48dc-b34d-adbe5de48512 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:26.937429 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d8e08-4ef9-4bf2-8fc7-3fb847a5155f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:26.938009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d8e08-4ef9-4bf2-8fc7-3fb847a5155f service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:26.938281 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d8e08-4ef9-4bf2-8fc7-3fb847a5155f service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:26.938548 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d8e08-4ef9-4bf2-8fc7-3fb847a5155f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:26.947058 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d8e08-4ef9-4bf2-8fc7-3fb847a5155f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:26.948456 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d8e08-4ef9-4bf2-8fc7-3fb847a5155f service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:26.957507 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 482/961] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:26 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:31.382010 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987feda0-bf6b-4d18-8e4d-fa011e96518e None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:31.382517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987feda0-bf6b-4d18-8e4d-fa011e96518e None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:31.382517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987feda0-bf6b-4d18-8e4d-fa011e96518e None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:31.383786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 480/962] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:31.389050 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65988ec-e157-4037-84f2-f81655999982 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:31.389481 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65988ec-e157-4037-84f2-f81655999982 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:31.389575 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65988ec-e157-4037-84f2-f81655999982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:31.408488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-a65988ec-e157-4037-84f2-f81655999982 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:31.409726 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-a65988ec-e157-4037-84f2-f81655999982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:31.417471 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 483/963] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:31.759928 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987feda0-bf6b-4d18-8e4d-fa011e96518e None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:31.770601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987feda0-bf6b-4d18-8e4d-fa011e96518e None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:31.773995 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906454a-ff55-4976-ae46-9f06fd4209a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:31.774578 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906454a-ff55-4976-ae46-9f06fd4209a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:31.774915 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906454a-ff55-4976-ae46-9f06fd4209a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:31.775182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906454a-ff55-4976-ae46-9f06fd4209a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:31.784075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906454a-ff55-4976-ae46-9f06fd4209a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:31.785521 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906454a-ff55-4976-ae46-9f06fd4209a0 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:31.795301 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 481/964] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:35.043408 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e148e2-cc61-4373-afed-8294528067f4 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:35.043931 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e148e2-cc61-4373-afed-8294528067f4 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:35.044018 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e148e2-cc61-4373-afed-8294528067f4 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:35.045316 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 484/965] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:35.050481 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493706-0fc9-4064-a861-f49b4fc35740 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:35.050920 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493706-0fc9-4064-a861-f49b4fc35740 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:35.051013 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493706-0fc9-4064-a861-f49b4fc35740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:35.070521 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-9c493706-0fc9-4064-a861-f49b4fc35740 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:35.071741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-9c493706-0fc9-4064-a861-f49b4fc35740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:35.080493 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 482/966] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:35 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:35.430658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e148e2-cc61-4373-afed-8294528067f4 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:35.442121 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e148e2-cc61-4373-afed-8294528067f4 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:35.445548 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be346a-d459-4274-9d8b-916aa476c44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:35.446139 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be346a-d459-4274-9d8b-916aa476c44d service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:35.446417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be346a-d459-4274-9d8b-916aa476c44d service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:35.446687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be346a-d459-4274-9d8b-916aa476c44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:35.455274 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be346a-d459-4274-9d8b-916aa476c44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:35.456690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be346a-d459-4274-9d8b-916aa476c44d service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:35.465917 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 485/967] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:35 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 17:37:39.956230 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132a34c-d867-47ce-b0e1-2d9c04ea472b None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:39.956802 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132a34c-d867-47ce-b0e1-2d9c04ea472b None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:39.956802 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132a34c-d867-47ce-b0e1-2d9c04ea472b None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:39.958127 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 483/968] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:39.963254 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2724d-c5b7-4b5c-ac7f-bb38c119f3c3 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:39.963680 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2724d-c5b7-4b5c-ac7f-bb38c119f3c3 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:39.963806 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2724d-c5b7-4b5c-ac7f-bb38c119f3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:39.983174 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-d6b2724d-c5b7-4b5c-ac7f-bb38c119f3c3 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:39.984345 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-d6b2724d-c5b7-4b5c-ac7f-bb38c119f3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:39.992205 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 486/969] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:40.329468 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132a34c-d867-47ce-b0e1-2d9c04ea472b None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:40.339993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132a34c-d867-47ce-b0e1-2d9c04ea472b None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:40.343404 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf16687-cf8e-46d3-895d-dd307f729797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:40.343987 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16687-cf8e-46d3-895d-dd307f729797 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:40.344260 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16687-cf8e-46d3-895d-dd307f729797 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:40.344528 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16687-cf8e-46d3-895d-dd307f729797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:40.353156 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf16687-cf8e-46d3-895d-dd307f729797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:40.354581 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf16687-cf8e-46d3-895d-dd307f729797 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:40.363700 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 484/970] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:45.850000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ecac2-9767-43d8-aa73-b083e62448ba None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:45.850516 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ecac2-9767-43d8-aa73-b083e62448ba None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:45.850714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ecac2-9767-43d8-aa73-b083e62448ba None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:45.852146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 487/971] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 19 17:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:45.865007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbcfe8-066b-457a-aa6f-88e545cda1d1 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:45.865007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbcfe8-066b-457a-aa6f-88e545cda1d1 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:45.865007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbcfe8-066b-457a-aa6f-88e545cda1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:45.904650 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-4cdbcfe8-066b-457a-aa6f-88e545cda1d1 None None] MFA Rules not processed for user `82313d212e4f454697849ea186208785`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:45.906706 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-4cdbcfe8-066b-457a-aa6f-88e545cda1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:46.011851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 485/972] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 19 17:37:45 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:49.978281 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=20 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:37:50.646283 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d619337-12e6-470f-9571-115eadfd5bc6 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:50.646809 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d619337-12e6-470f-9571-115eadfd5bc6 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:50.647103 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d619337-12e6-470f-9571-115eadfd5bc6 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:50.648615 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 488/973] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 19 17:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:50.653501 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde19642-5cc6-4d9b-a9a3-905b036dde23 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:50.654010 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde19642-5cc6-4d9b-a9a3-905b036dde23 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:50.654105 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde19642-5cc6-4d9b-a9a3-905b036dde23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:50.673845 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-cde19642-5cc6-4d9b-a9a3-905b036dde23 None None] MFA Rules not processed for user `82313d212e4f454697849ea186208785`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:50.675305 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-cde19642-5cc6-4d9b-a9a3-905b036dde23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:50.685305 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 486/974] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 19 17:37:50 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:52.309605 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f01d0-ddbe-43e6-8d7f-d2190fced871 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:52.310144 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f01d0-ddbe-43e6-8d7f-d2190fced871 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:52.310144 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f01d0-ddbe-43e6-8d7f-d2190fced871 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:52.311647 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 489/975] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 19 17:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:52.317034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc7015-f81b-4a58-951e-0e9520999295 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:52.317473 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc7015-f81b-4a58-951e-0e9520999295 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:52.317570 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc7015-f81b-4a58-951e-0e9520999295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:52.337249 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-1bbc7015-f81b-4a58-951e-0e9520999295 None None] MFA Rules not processed for user `82313d212e4f454697849ea186208785`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:52.338423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-1bbc7015-f81b-4a58-951e-0e9520999295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:52.346569 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 487/976] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 19 17:37:52 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:37:56.353037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decd2e1-b383-41f1-9adb-6f38613fe168 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:56.354116 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decd2e1-b383-41f1-9adb-6f38613fe168 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:56.354648 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decd2e1-b383-41f1-9adb-6f38613fe168 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:56.356583 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 490/977] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:56.363009 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e21bea-0aa4-4589-8571-944857719b41 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:56.366100 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e21bea-0aa4-4589-8571-944857719b41 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:56.366602 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e21bea-0aa4-4589-8571-944857719b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:56.375216 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=69 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:37:56.389722 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-b5e21bea-0aa4-4589-8571-944857719b41 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:56.391199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-b5e21bea-0aa4-4589-8571-944857719b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:56.400712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 488/978] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:56.761891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312cb18-1e50-4415-bf2a-3565a66bef30 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:56.763154 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312cb18-1e50-4415-bf2a-3565a66bef30 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:56.763637 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312cb18-1e50-4415-bf2a-3565a66bef30 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:56.765855 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 491/979] 10.222.0.27 () {54 vars in 962 bytes} [Fri Aug 19 17:37:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:56.773940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8697c-a367-49d2-b1bf-fff16008b661 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:56.781934 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8697c-a367-49d2-b1bf-fff16008b661 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:56.781934 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8697c-a367-49d2-b1bf-fff16008b661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:56.833156 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-dbd8697c-a367-49d2-b1bf-fff16008b661 None None] MFA Rules not processed for user `fb1c954936f64051b09afba8df544ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:56.834531 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-dbd8697c-a367-49d2-b1bf-fff16008b661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:56.918511 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 489/980] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Aug 19 17:37:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:56.926240 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312cb18-1e50-4415-bf2a-3565a66bef30 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:56.941423 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312cb18-1e50-4415-bf2a-3565a66bef30 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:56.946610 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffbbf5-9473-4b86-bf8a-677700796db0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:56.947212 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffbbf5-9473-4b86-bf8a-677700796db0 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:56.953031 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffbbf5-9473-4b86-bf8a-677700796db0 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:56.953031 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffbbf5-9473-4b86-bf8a-677700796db0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:56.957183 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffbbf5-9473-4b86-bf8a-677700796db0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:56.958828 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffbbf5-9473-4b86-bf8a-677700796db0 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:56.969481 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 492/981] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:37:59.388887 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1e15-d524-475a-94f7-072cffcb92bb None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:59.389435 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1e15-d524-475a-94f7-072cffcb92bb None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:59.389435 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1e15-d524-475a-94f7-072cffcb92bb None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:59.390956 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 490/982] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:37:59.396441 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c7ed0-b80e-4e05-b28b-9fe45e750c37 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:59.396882 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c7ed0-b80e-4e05-b28b-9fe45e750c37 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:59.397027 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c7ed0-b80e-4e05-b28b-9fe45e750c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:59.419579 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-423c7ed0-b80e-4e05-b28b-9fe45e750c37 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:37:59.421242 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-423c7ed0-b80e-4e05-b28b-9fe45e750c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:37:59.433577 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 493/983] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:37:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:37:59.779319 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a1e15-d524-475a-94f7-072cffcb92bb None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:37:59.792989 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a1e15-d524-475a-94f7-072cffcb92bb None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:37:59.798011 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5beba-45ce-4584-a101-a2b0e0c4c52f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:37:59.798597 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5beba-45ce-4584-a101-a2b0e0c4c52f service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:37:59.798871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5beba-45ce-4584-a101-a2b0e0c4c52f service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:37:59.799138 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5beba-45ce-4584-a101-a2b0e0c4c52f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:37:59.807682 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5beba-45ce-4584-a101-a2b0e0c4c52f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:37:59.809773 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5beba-45ce-4584-a101-a2b0e0c4c52f service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:37:59.819589 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 491/984] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:37:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:02.487091 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807de26-2e84-4f9d-b0b2-e889ef18a226 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:02.488272 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807de26-2e84-4f9d-b0b2-e889ef18a226 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:02.488782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807de26-2e84-4f9d-b0b2-e889ef18a226 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:02.490410 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 494/985] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:02.498187 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2250864-0387-464b-a49a-c4d40b738ca8 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:02.499161 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2250864-0387-464b-a49a-c4d40b738ca8 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:02.499671 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2250864-0387-464b-a49a-c4d40b738ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:02.521268 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-b2250864-0387-464b-a49a-c4d40b738ca8 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:02.522777 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-b2250864-0387-464b-a49a-c4d40b738ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:02.531203 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 492/986] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:38:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:02.898247 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f44f16-c679-45bf-ad03-0f407a06555b None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:02.898539 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f44f16-c679-45bf-ad03-0f407a06555b None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:02.898805 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f44f16-c679-45bf-ad03-0f407a06555b None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:02.900103 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 495/987] 10.222.0.27 () {54 vars in 962 bytes} [Fri Aug 19 17:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:02.907231 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d52e8-6fb3-4d2a-981c-a2b0921e199b None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:02.907515 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d52e8-6fb3-4d2a-981c-a2b0921e199b None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:02.907952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d52e8-6fb3-4d2a-981c-a2b0921e199b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:02.933556 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-555d52e8-6fb3-4d2a-981c-a2b0921e199b None None] MFA Rules not processed for user `fb1c954936f64051b09afba8df544ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:02.934814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-555d52e8-6fb3-4d2a-981c-a2b0921e199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:02.943745 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 493/988] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Aug 19 17:38:02 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:38:02.952387 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f44f16-c679-45bf-ad03-0f407a06555b None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:02.968101 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f44f16-c679-45bf-ad03-0f407a06555b None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:02.976695 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88ec7e-e207-43d9-b244-086abd3062c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:02.977095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ec7e-e207-43d9-b244-086abd3062c7 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:02.977326 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ec7e-e207-43d9-b244-086abd3062c7 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:02.977595 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ec7e-e207-43d9-b244-086abd3062c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:02.989106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88ec7e-e207-43d9-b244-086abd3062c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:02.990891 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88ec7e-e207-43d9-b244-086abd3062c7 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:03.000857 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 496/989] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:05.506169 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd24058-7176-439d-a562-3677301e27e8 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:05.507153 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd24058-7176-439d-a562-3677301e27e8 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:05.507628 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd24058-7176-439d-a562-3677301e27e8 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:05.515202 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaf138-4193-4001-8c24-2984d2576e32 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:05.516101 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaf138-4193-4001-8c24-2984d2576e32 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:05.516594 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaf138-4193-4001-8c24-2984d2576e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:05.519446 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 494/990] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:38:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:05.537638 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-afdaf138-4193-4001-8c24-2984d2576e32 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:05.539183 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-afdaf138-4193-4001-8c24-2984d2576e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:05.556753 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 497/991] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:38:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:38:05.909032 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd24058-7176-439d-a562-3677301e27e8 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:05.924207 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd24058-7176-439d-a562-3677301e27e8 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:05.930029 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d9dd7-d168-497f-84a3-0d2cccc7106c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:05.931029 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9dd7-d168-497f-84a3-0d2cccc7106c service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:05.931777 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9dd7-d168-497f-84a3-0d2cccc7106c service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:05.932251 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d9dd7-d168-497f-84a3-0d2cccc7106c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:05.941968 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d9dd7-d168-497f-84a3-0d2cccc7106c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:05.943957 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d9dd7-d168-497f-84a3-0d2cccc7106c service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:05.967586 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 495/992] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:06.607724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa1757-43d6-4db6-832f-e77ed3f6a22d None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:06.608169 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa1757-43d6-4db6-832f-e77ed3f6a22d None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:06.608333 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa1757-43d6-4db6-832f-e77ed3f6a22d None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:06.609943 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 498/993] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:06.623009 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea8ab8-494c-43d1-a6fb-92b79f8fc830 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:06.624274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea8ab8-494c-43d1-a6fb-92b79f8fc830 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:06.625166 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea8ab8-494c-43d1-a6fb-92b79f8fc830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:06.663555 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-a7ea8ab8-494c-43d1-a6fb-92b79f8fc830 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:06.665608 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-a7ea8ab8-494c-43d1-a6fb-92b79f8fc830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:06.675101 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 496/994] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:38:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:07.286888 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaf198-f76e-4c9f-bd74-49fed2ba384d None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:07.286888 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaf198-f76e-4c9f-bd74-49fed2ba384d None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:07.286888 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaf198-f76e-4c9f-bd74-49fed2ba384d None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:07.289778 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 499/995] 10.222.0.27 () {54 vars in 964 bytes} [Fri Aug 19 17:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:07.296648 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ab82-4500-4186-9c05-59c654723425 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:07.296648 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ab82-4500-4186-9c05-59c654723425 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:07.296648 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41ab82-4500-4186-9c05-59c654723425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:07.346569 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-6d41ab82-4500-4186-9c05-59c654723425 None None] MFA Rules not processed for user `c0d818956e1048a096830ec372382e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:07.348128 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-6d41ab82-4500-4186-9c05-59c654723425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:07.394598 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:38:07.422673 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 497/996] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Aug 19 17:38:07 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:07.426933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaf198-f76e-4c9f-bd74-49fed2ba384d None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:07.439504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaf198-f76e-4c9f-bd74-49fed2ba384d None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:07.443047 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaac32-fe37-4e8b-bdba-e23435093da7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d818956e1048a096830ec372382e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:07.443864 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaac32-fe37-4e8b-bdba-e23435093da7 service cinder] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:07.444214 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaac32-fe37-4e8b-bdba-e23435093da7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:07.444556 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaac32-fe37-4e8b-bdba-e23435093da7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:07.453482 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaac32-fe37-4e8b-bdba-e23435093da7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:07.454979 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaac32-fe37-4e8b-bdba-e23435093da7 service cinder] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:07.464924 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 500/997] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:08.497856 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2712ab6-0bf0-451a-a8ff-7b704b39d976 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:08.498282 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2712ab6-0bf0-451a-a8ff-7b704b39d976 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:08.498430 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2712ab6-0bf0-451a-a8ff-7b704b39d976 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:08.505723 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8238e-6f82-41e5-8272-502341176df6 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:08.506290 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8238e-6f82-41e5-8272-502341176df6 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:08.506699 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8238e-6f82-41e5-8272-502341176df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:08.508895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 498/998] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:38:08 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:08.536002 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-e4d8238e-6f82-41e5-8272-502341176df6 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:08.537316 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-e4d8238e-6f82-41e5-8272-502341176df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:08.546109 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 501/999] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:38:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:08.890712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2712ab6-0bf0-451a-a8ff-7b704b39d976 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:08.908300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2712ab6-0bf0-451a-a8ff-7b704b39d976 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:08.914203 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ae95e-c548-41c9-a53f-ca6e3693d0dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:08.914915 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ae95e-c548-41c9-a53f-ca6e3693d0dc service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:08.915279 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ae95e-c548-41c9-a53f-ca6e3693d0dc service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:08.915622 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ae95e-c548-41c9-a53f-ca6e3693d0dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:08.927176 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ae95e-c548-41c9-a53f-ca6e3693d0dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:08.929527 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ae95e-c548-41c9-a53f-ca6e3693d0dc service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:08.940524 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 499/1000] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:11.324595 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710777-c92d-4dcd-afc9-8c3787298dd2 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:11.325125 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710777-c92d-4dcd-afc9-8c3787298dd2 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:11.325250 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8710777-c92d-4dcd-afc9-8c3787298dd2 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:11.326473 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 502/1001] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:11.331596 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dfc52-c8c4-4fff-8291-c3407b9032d6 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:11.331981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dfc52-c8c4-4fff-8291-c3407b9032d6 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:11.332144 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dfc52-c8c4-4fff-8291-c3407b9032d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:11.350903 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-cf7dfc52-c8c4-4fff-8291-c3407b9032d6 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:11.352090 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-cf7dfc52-c8c4-4fff-8291-c3407b9032d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:11.360211 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 500/1002] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:38:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:11.720163 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8710777-c92d-4dcd-afc9-8c3787298dd2 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:11.734682 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8710777-c92d-4dcd-afc9-8c3787298dd2 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:11.739777 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174d32a-c237-422e-bfe9-6d47bc6315d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:11.740366 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174d32a-c237-422e-bfe9-6d47bc6315d2 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:11.740639 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174d32a-c237-422e-bfe9-6d47bc6315d2 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:11.740936 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174d32a-c237-422e-bfe9-6d47bc6315d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:11.749480 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174d32a-c237-422e-bfe9-6d47bc6315d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:11.751064 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174d32a-c237-422e-bfe9-6d47bc6315d2 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:11.763932 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 503/1003] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:14.122600 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37494f4f-7526-4d67-85c3-24bcca443cf5 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:14.123124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37494f4f-7526-4d67-85c3-24bcca443cf5 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:14.123124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37494f4f-7526-4d67-85c3-24bcca443cf5 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:14.124818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 501/1004] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:14.129960 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ec35f-eea2-49a9-8bb6-fa8bc21ce290 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:14.130520 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ec35f-eea2-49a9-8bb6-fa8bc21ce290 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:14.130520 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ec35f-eea2-49a9-8bb6-fa8bc21ce290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:14.150777 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-b84ec35f-eea2-49a9-8bb6-fa8bc21ce290 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:14.152055 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-b84ec35f-eea2-49a9-8bb6-fa8bc21ce290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:14.160709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 504/1005] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:38:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:14.513840 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37494f4f-7526-4d67-85c3-24bcca443cf5 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:14.527317 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37494f4f-7526-4d67-85c3-24bcca443cf5 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:14.533069 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35976d9-27a9-4389-9da1-8d57b3d365eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:14.533672 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35976d9-27a9-4389-9da1-8d57b3d365eb service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:14.533947 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35976d9-27a9-4389-9da1-8d57b3d365eb service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:14.534214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35976d9-27a9-4389-9da1-8d57b3d365eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:14.543012 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35976d9-27a9-4389-9da1-8d57b3d365eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:14.544590 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35976d9-27a9-4389-9da1-8d57b3d365eb service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:14.554429 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 502/1006] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:16.766508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eccacf-531c-4139-94a4-c03b904a1681 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:16.767025 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eccacf-531c-4139-94a4-c03b904a1681 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:16.767025 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eccacf-531c-4139-94a4-c03b904a1681 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:16.768385 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 505/1007] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:16.775062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b212d5-3987-4e40-9175-89fceb28b277 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:16.775474 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b212d5-3987-4e40-9175-89fceb28b277 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:16.775806 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b212d5-3987-4e40-9175-89fceb28b277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:16.798900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-80b212d5-3987-4e40-9175-89fceb28b277 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:16.800494 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-80b212d5-3987-4e40-9175-89fceb28b277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:16.809934 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 503/1008] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:38:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:17.161861 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eccacf-531c-4139-94a4-c03b904a1681 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:17.175564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eccacf-531c-4139-94a4-c03b904a1681 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:17.180568 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14425ead-df36-4a66-add4-457d7ebb0825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:17.181223 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425ead-df36-4a66-add4-457d7ebb0825 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:17.181497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425ead-df36-4a66-add4-457d7ebb0825 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:17.182354 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425ead-df36-4a66-add4-457d7ebb0825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:17.192086 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14425ead-df36-4a66-add4-457d7ebb0825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:17.193705 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14425ead-df36-4a66-add4-457d7ebb0825 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:17.208470 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 506/1009] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:20.171453 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fbf19-fd87-4203-a10f-47bfa33988ab None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:20.172276 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fbf19-fd87-4203-a10f-47bfa33988ab None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:20.172276 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fbf19-fd87-4203-a10f-47bfa33988ab None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:20.173346 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 504/1010] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:20.178775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f6bde-9d8c-44c2-a6da-e35a666ea56e None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:20.179267 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f6bde-9d8c-44c2-a6da-e35a666ea56e None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:20.179372 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f6bde-9d8c-44c2-a6da-e35a666ea56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:20.187510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=43 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:38:20.200753 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-046f6bde-9d8c-44c2-a6da-e35a666ea56e None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:20.201946 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-046f6bde-9d8c-44c2-a6da-e35a666ea56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:20.210314 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 507/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:38:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:38:20.721800 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fbf19-fd87-4203-a10f-47bfa33988ab None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:20.735126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fbf19-fd87-4203-a10f-47bfa33988ab None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:20.740029 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf02c95-bd28-4b55-9843-4d7851277d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:20.740615 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf02c95-bd28-4b55-9843-4d7851277d84 service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:20.740914 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf02c95-bd28-4b55-9843-4d7851277d84 service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:20.741210 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf02c95-bd28-4b55-9843-4d7851277d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:20.749901 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf02c95-bd28-4b55-9843-4d7851277d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:20.751490 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf02c95-bd28-4b55-9843-4d7851277d84 service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:20.760956 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 505/1012] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:23.733191 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502bce4-9091-4fc3-a901-7fd25ec8795d None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:23.733793 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502bce4-9091-4fc3-a901-7fd25ec8795d None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:23.733793 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502bce4-9091-4fc3-a901-7fd25ec8795d None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:23.734963 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 508/1013] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:23.740200 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d81e-8158-423e-8e79-8b1b97a8e892 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:23.740641 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d81e-8158-423e-8e79-8b1b97a8e892 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:23.740767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d81e-8158-423e-8e79-8b1b97a8e892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:23.759880 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-1fc9d81e-8158-423e-8e79-8b1b97a8e892 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:23.766974 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-1fc9d81e-8158-423e-8e79-8b1b97a8e892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:23.769172 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 506/1014] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:38:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:38:24.111014 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502bce4-9091-4fc3-a901-7fd25ec8795d None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:24.125735 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502bce4-9091-4fc3-a901-7fd25ec8795d None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:24.131322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf9667-1efa-461f-a39d-3b98e1109944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:24.131953 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9667-1efa-461f-a39d-3b98e1109944 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:24.132494 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9667-1efa-461f-a39d-3b98e1109944 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:24.132494 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9667-1efa-461f-a39d-3b98e1109944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:24.141666 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf9667-1efa-461f-a39d-3b98e1109944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:24.143293 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf9667-1efa-461f-a39d-3b98e1109944 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:24.153694 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 509/1015] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:24.280304 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbbfa7-43d2-4ab6-a6cc-4942a1494e58 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:24.280588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbbfa7-43d2-4ab6-a6cc-4942a1494e58 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:24.280899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbbfa7-43d2-4ab6-a6cc-4942a1494e58 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:24.282228 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 507/1016] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:24.287504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f573f-5436-4d95-9434-cdbc4ed04e09 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:24.287790 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f573f-5436-4d95-9434-cdbc4ed04e09 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:24.288065 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f573f-5436-4d95-9434-cdbc4ed04e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:24.307315 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-d10f573f-5436-4d95-9434-cdbc4ed04e09 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:24.308502 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-d10f573f-5436-4d95-9434-cdbc4ed04e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:24.316929 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 510/1017] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:38:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:24.673771 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf37e-f531-4c5e-b3be-f871a0a90717 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:24.674066 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf37e-f531-4c5e-b3be-f871a0a90717 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:24.674404 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf37e-f531-4c5e-b3be-f871a0a90717 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:24.675848 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 508/1018] 10.222.0.27 () {54 vars in 967 bytes} [Fri Aug 19 17:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:24.680970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3d09a-fc78-41fc-842a-ad334eeba8b3 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:24.681261 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3d09a-fc78-41fc-842a-ad334eeba8b3 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:24.681537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3d09a-fc78-41fc-842a-ad334eeba8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:24.730973 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-deb3d09a-fc78-41fc-842a-ad334eeba8b3 None None] MFA Rules not processed for user `fbe5b4476e8e413f8d409c8e73c4c4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:24.732686 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-deb3d09a-fc78-41fc-842a-ad334eeba8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:24.790400 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 511/1019] 10.222.0.27 () {58 vars in 1064 bytes} [Fri Aug 19 17:38:24 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:24.798832 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bf37e-f531-4c5e-b3be-f871a0a90717 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:24.810448 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bf37e-f531-4c5e-b3be-f871a0a90717 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:24.813840 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c84ed2-f37d-447d-a91f-5a93832c6ac6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe5b4476e8e413f8d409c8e73c4c4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:24.814411 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84ed2-f37d-447d-a91f-5a93832c6ac6 service glance] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:24.814683 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84ed2-f37d-447d-a91f-5a93832c6ac6 service glance] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:24.814947 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84ed2-f37d-447d-a91f-5a93832c6ac6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:24.823588 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c84ed2-f37d-447d-a91f-5a93832c6ac6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:24.825021 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c84ed2-f37d-447d-a91f-5a93832c6ac6 service glance] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:24.834493 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 509/1020] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:26.621498 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6842c2-61ca-4fc6-99d3-7f40777f641e None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:26.622631 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6842c2-61ca-4fc6-99d3-7f40777f641e None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:26.622631 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6842c2-61ca-4fc6-99d3-7f40777f641e None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:26.623892 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 512/1021] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:26.629585 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51537f31-2b71-489e-9780-596111f1e939 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:26.630131 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51537f31-2b71-489e-9780-596111f1e939 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:26.630131 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51537f31-2b71-489e-9780-596111f1e939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:26.649862 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-51537f31-2b71-489e-9780-596111f1e939 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:26.651071 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-51537f31-2b71-489e-9780-596111f1e939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:26.662854 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 510/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:38:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:27.013501 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6842c2-61ca-4fc6-99d3-7f40777f641e None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:27.028813 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6842c2-61ca-4fc6-99d3-7f40777f641e None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:27.033687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90aad1-68ff-4bfe-b215-722fbb3a9ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:27.034286 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90aad1-68ff-4bfe-b215-722fbb3a9ca0 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:27.034562 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90aad1-68ff-4bfe-b215-722fbb3a9ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:27.034833 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90aad1-68ff-4bfe-b215-722fbb3a9ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:27.045937 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90aad1-68ff-4bfe-b215-722fbb3a9ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:27.047528 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90aad1-68ff-4bfe-b215-722fbb3a9ca0 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:27.057301 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 513/1023] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:29.434025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7333e-8bf9-4a34-97b7-38cf35b59d7e None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:29.435829 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7333e-8bf9-4a34-97b7-38cf35b59d7e None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:29.436343 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7333e-8bf9-4a34-97b7-38cf35b59d7e None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:29.437930 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 511/1024] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:38:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:29.443525 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be47f41-1039-4af5-8fb6-b56c97f0e882 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:29.444021 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be47f41-1039-4af5-8fb6-b56c97f0e882 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:29.444211 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be47f41-1039-4af5-8fb6-b56c97f0e882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:29.468683 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-0be47f41-1039-4af5-8fb6-b56c97f0e882 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:29.470187 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-0be47f41-1039-4af5-8fb6-b56c97f0e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:29.478305 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 514/1025] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:38:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:29.865501 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7333e-8bf9-4a34-97b7-38cf35b59d7e None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:29.880237 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7333e-8bf9-4a34-97b7-38cf35b59d7e None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:29.885541 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baeba5-e82a-4d1a-9a45-d92d1392642c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:29.886132 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baeba5-e82a-4d1a-9a45-d92d1392642c service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:29.886405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baeba5-e82a-4d1a-9a45-d92d1392642c service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:29.886669 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baeba5-e82a-4d1a-9a45-d92d1392642c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:29.895920 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baeba5-e82a-4d1a-9a45-d92d1392642c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:29.897562 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baeba5-e82a-4d1a-9a45-d92d1392642c service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:29.907731 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 512/1026] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 17:38:39.461516 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=58 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:38:39.903810 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=47 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:38:40.975657 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2af679-0e32-4dc9-b1d5-d524a9af7648 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:40.976194 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2af679-0e32-4dc9-b1d5-d524a9af7648 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:40.976194 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2af679-0e32-4dc9-b1d5-d524a9af7648 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:40.977536 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 515/1027] 10.222.0.27 () {54 vars in 918 bytes} [Fri Aug 19 17:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:40.982636 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d87ae-36b4-4dd2-950e-e5ce0c3f3e9a None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:40.983060 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d87ae-36b4-4dd2-950e-e5ce0c3f3e9a None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:40.983170 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d87ae-36b4-4dd2-950e-e5ce0c3f3e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:41.008097 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-d94d87ae-36b4-4dd2-950e-e5ce0c3f3e9a None None] MFA Rules not processed for user `82313d212e4f454697849ea186208785`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:41.009871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-d94d87ae-36b4-4dd2-950e-e5ce0c3f3e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:41.022040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 513/1028] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Aug 19 17:38:40 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:38:41.036257 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82faae-69fe-43e6-950d-2cb50195ac6b None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:41.036537 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82faae-69fe-43e6-950d-2cb50195ac6b None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:41.036834 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82faae-69fe-43e6-950d-2cb50195ac6b None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:41.038136 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 516/1029] 10.222.0.27 () {54 vars in 918 bytes} [Fri Aug 19 17:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:41.042641 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c433f-7af0-4d40-8c6c-c5b0c7280a51 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:41.042925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c433f-7af0-4d40-8c6c-c5b0c7280a51 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:41.043197 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c433f-7af0-4d40-8c6c-c5b0c7280a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:41.062615 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-885c433f-7af0-4d40-8c6c-c5b0c7280a51 None None] MFA Rules not processed for user `fb1c954936f64051b09afba8df544ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:41.063774 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-885c433f-7af0-4d40-8c6c-c5b0c7280a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:41.071952 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 514/1030] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Aug 19 17:38:41 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:43.783232 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6a873-007f-4907-b00b-e078885fc0ef None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:43.783779 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6a873-007f-4907-b00b-e078885fc0ef None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:43.783779 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6a873-007f-4907-b00b-e078885fc0ef None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:43.785030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 517/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:43.790143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae2d5-0ab8-4d92-abdc-975b8a409832 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:43.790600 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae2d5-0ab8-4d92-abdc-975b8a409832 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:43.790728 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae2d5-0ab8-4d92-abdc-975b8a409832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:43.810149 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-aa8ae2d5-0ab8-4d92-abdc-975b8a409832 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:43.811346 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-aa8ae2d5-0ab8-4d92-abdc-975b8a409832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:43.819058 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 515/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:38:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:44.194862 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6a873-007f-4907-b00b-e078885fc0ef None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:44.208826 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6a873-007f-4907-b00b-e078885fc0ef None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:44.213709 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72204f2a-12ed-4ff9-85c8-9a8215d9ef73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:44.221380 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72204f2a-12ed-4ff9-85c8-9a8215d9ef73 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:44.221380 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72204f2a-12ed-4ff9-85c8-9a8215d9ef73 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:44.221380 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72204f2a-12ed-4ff9-85c8-9a8215d9ef73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:44.223760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72204f2a-12ed-4ff9-85c8-9a8215d9ef73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:44.225434 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72204f2a-12ed-4ff9-85c8-9a8215d9ef73 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:44.234795 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 518/1033] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:45.193453 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c4c52-7c7e-49c5-afee-1d23d1937bb1 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:45.193991 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c4c52-7c7e-49c5-afee-1d23d1937bb1 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:45.193991 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c4c52-7c7e-49c5-afee-1d23d1937bb1 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:45.195323 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 516/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:45.200051 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61b890-5102-4424-8526-5fec2e8d79d5 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:45.200441 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61b890-5102-4424-8526-5fec2e8d79d5 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:45.200605 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61b890-5102-4424-8526-5fec2e8d79d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:45.221456 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-5e61b890-5102-4424-8526-5fec2e8d79d5 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:45.221727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-5e61b890-5102-4424-8526-5fec2e8d79d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:45.229440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 519/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:38:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:45.430362 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c4c52-7c7e-49c5-afee-1d23d1937bb1 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:45.444262 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c4c52-7c7e-49c5-afee-1d23d1937bb1 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:45.449153 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be621a6c-0208-4375-bbc8-a83f38aa089e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:45.449727 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be621a6c-0208-4375-bbc8-a83f38aa089e service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:45.450005 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be621a6c-0208-4375-bbc8-a83f38aa089e service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:45.450274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be621a6c-0208-4375-bbc8-a83f38aa089e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:45.458659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be621a6c-0208-4375-bbc8-a83f38aa089e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:45.460245 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be621a6c-0208-4375-bbc8-a83f38aa089e service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:45.469350 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 517/1036] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:46.365026 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b405e-4beb-42bd-9366-56d0f657f0f3 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:46.365577 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b405e-4beb-42bd-9366-56d0f657f0f3 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:46.365577 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b405e-4beb-42bd-9366-56d0f657f0f3 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:46.366885 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 520/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:46.371800 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fd5e0-eaff-4b35-b342-312259bfbd6a None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:46.372200 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fd5e0-eaff-4b35-b342-312259bfbd6a None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:46.372373 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fd5e0-eaff-4b35-b342-312259bfbd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:46.392836 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-1f7fd5e0-eaff-4b35-b342-312259bfbd6a None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:46.394041 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-1f7fd5e0-eaff-4b35-b342-312259bfbd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:46.401849 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 518/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:38:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:38:46.558364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b405e-4beb-42bd-9366-56d0f657f0f3 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:46.571344 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b405e-4beb-42bd-9366-56d0f657f0f3 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:46.576243 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f285b2-ff23-4d8b-9f7a-66cd4ba5fac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:46.576901 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f285b2-ff23-4d8b-9f7a-66cd4ba5fac6 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:46.577181 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f285b2-ff23-4d8b-9f7a-66cd4ba5fac6 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:46.577957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f285b2-ff23-4d8b-9f7a-66cd4ba5fac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:46.585912 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f285b2-ff23-4d8b-9f7a-66cd4ba5fac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:46.587480 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f285b2-ff23-4d8b-9f7a-66cd4ba5fac6 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:46.597330 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 521/1039] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:47.449984 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada96a09-fb82-4ba8-9113-7c0c584b3b64 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:47.450448 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada96a09-fb82-4ba8-9113-7c0c584b3b64 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:47.450555 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada96a09-fb82-4ba8-9113-7c0c584b3b64 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:47.451838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 519/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:47.456940 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2cc1e-b607-45fc-9b76-42c5fbf72d8e None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:47.457380 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2cc1e-b607-45fc-9b76-42c5fbf72d8e None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:47.457486 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2cc1e-b607-45fc-9b76-42c5fbf72d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:47.476281 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-f5c2cc1e-b607-45fc-9b76-42c5fbf72d8e None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:47.477504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-f5c2cc1e-b607-45fc-9b76-42c5fbf72d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:47.485735 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 522/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:38:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:47.640657 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada96a09-fb82-4ba8-9113-7c0c584b3b64 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:47.653697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada96a09-fb82-4ba8-9113-7c0c584b3b64 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:47.659113 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b82f4e-89f9-4181-9577-84433c17dfca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:47.659689 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82f4e-89f9-4181-9577-84433c17dfca service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:47.659964 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82f4e-89f9-4181-9577-84433c17dfca service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:47.660232 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82f4e-89f9-4181-9577-84433c17dfca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:47.667962 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b82f4e-89f9-4181-9577-84433c17dfca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:47.669566 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b82f4e-89f9-4181-9577-84433c17dfca service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:47.679360 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 520/1042] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:48.535969 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d22a6-d9da-4412-a926-fbc1b4dd28ce None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:48.536521 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d22a6-d9da-4412-a926-fbc1b4dd28ce None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:48.536521 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d22a6-d9da-4412-a926-fbc1b4dd28ce None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:48.537847 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 523/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:48.542749 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895dc7b-d2e9-4a9f-b801-a08ba3ff91f2 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:48.543174 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895dc7b-d2e9-4a9f-b801-a08ba3ff91f2 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:48.543296 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895dc7b-d2e9-4a9f-b801-a08ba3ff91f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:48.562858 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-0895dc7b-d2e9-4a9f-b801-a08ba3ff91f2 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:48.564034 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-0895dc7b-d2e9-4a9f-b801-a08ba3ff91f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:48.571686 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 521/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:38:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:48.727803 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d22a6-d9da-4412-a926-fbc1b4dd28ce None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:48.740744 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d22a6-d9da-4412-a926-fbc1b4dd28ce None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:48.745531 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e60720-e918-4cb6-a3b8-68da5d4af416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:48.746106 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60720-e918-4cb6-a3b8-68da5d4af416 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:48.746379 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60720-e918-4cb6-a3b8-68da5d4af416 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:48.746647 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60720-e918-4cb6-a3b8-68da5d4af416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:48.754416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e60720-e918-4cb6-a3b8-68da5d4af416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:48.755975 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e60720-e918-4cb6-a3b8-68da5d4af416 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:48.764939 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 524/1045] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:49.650515 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d997e-8dae-4955-9901-9e26438a4c33 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:49.651093 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d997e-8dae-4955-9901-9e26438a4c33 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:49.651093 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d997e-8dae-4955-9901-9e26438a4c33 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:49.652387 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 522/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:49.657196 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac926c1e-7489-45b3-87ce-4bad593ea9a9 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:49.657649 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac926c1e-7489-45b3-87ce-4bad593ea9a9 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:49.657758 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac926c1e-7489-45b3-87ce-4bad593ea9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:49.676932 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-ac926c1e-7489-45b3-87ce-4bad593ea9a9 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:49.678036 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-ac926c1e-7489-45b3-87ce-4bad593ea9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:49.685796 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 525/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:38:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:38:49.841621 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d997e-8dae-4955-9901-9e26438a4c33 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:49.858753 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d997e-8dae-4955-9901-9e26438a4c33 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:49.864434 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d1004-d06a-43bd-9c8f-96bd941da50f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:49.865055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d1004-d06a-43bd-9c8f-96bd941da50f service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:49.865331 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d1004-d06a-43bd-9c8f-96bd941da50f service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:49.865598 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d1004-d06a-43bd-9c8f-96bd941da50f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:49.873835 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d1004-d06a-43bd-9c8f-96bd941da50f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:49.875402 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d1004-d06a-43bd-9c8f-96bd941da50f service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:49.884767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 523/1048] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:50.845090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca368d-3902-4910-b4f5-80b49e43787c None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:50.845620 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca368d-3902-4910-b4f5-80b49e43787c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:50.845620 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca368d-3902-4910-b4f5-80b49e43787c None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:50.846976 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 526/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:50.851940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71f14b-2f8e-4d62-9fa5-2410583fb08e None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:50.852382 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71f14b-2f8e-4d62-9fa5-2410583fb08e None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:50.852479 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71f14b-2f8e-4d62-9fa5-2410583fb08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:50.871782 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-fd71f14b-2f8e-4d62-9fa5-2410583fb08e None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:50.872989 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-fd71f14b-2f8e-4d62-9fa5-2410583fb08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:50.881426 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 524/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:38:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:51.034767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca368d-3902-4910-b4f5-80b49e43787c None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:51.048141 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca368d-3902-4910-b4f5-80b49e43787c None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:51.053548 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9152d7-22ce-495b-9fd7-fa94feadc8ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:51.060230 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9152d7-22ce-495b-9fd7-fa94feadc8ef service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:51.060230 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9152d7-22ce-495b-9fd7-fa94feadc8ef service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:51.060230 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9152d7-22ce-495b-9fd7-fa94feadc8ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:51.062860 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9152d7-22ce-495b-9fd7-fa94feadc8ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:51.065070 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9152d7-22ce-495b-9fd7-fa94feadc8ef service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:51.074520 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 527/1051] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:51.983552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ac379-4cf0-48b1-9517-a62c5db564c0 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:51.984127 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ac379-4cf0-48b1-9517-a62c5db564c0 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:51.984127 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ac379-4cf0-48b1-9517-a62c5db564c0 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:51.985474 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 525/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:51.990617 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a69785-1757-4b04-af24-814e85ccab9b None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:51.991019 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a69785-1757-4b04-af24-814e85ccab9b None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:51.991193 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a69785-1757-4b04-af24-814e85ccab9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:52.010509 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-49a69785-1757-4b04-af24-814e85ccab9b None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:52.011707 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-49a69785-1757-4b04-af24-814e85ccab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:52.019457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 528/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:38:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:52.173199 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ac379-4cf0-48b1-9517-a62c5db564c0 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:52.187793 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ac379-4cf0-48b1-9517-a62c5db564c0 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:52.192279 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1d263-7a10-4562-b4c5-865a0869a41a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:52.192959 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1d263-7a10-4562-b4c5-865a0869a41a service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:52.193241 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1d263-7a10-4562-b4c5-865a0869a41a service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:52.193503 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1d263-7a10-4562-b4c5-865a0869a41a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:52.201361 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1d263-7a10-4562-b4c5-865a0869a41a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:52.202942 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1d263-7a10-4562-b4c5-865a0869a41a service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:52.211888 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 526/1054] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:53.118613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be42f-fd1c-4c70-8b9e-48e97d6229d8 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:53.119187 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be42f-fd1c-4c70-8b9e-48e97d6229d8 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:53.119187 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be42f-fd1c-4c70-8b9e-48e97d6229d8 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:53.120618 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 529/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:53.125845 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7248321-1cd9-4aed-a732-be0aa9b6061f None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:53.126253 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7248321-1cd9-4aed-a732-be0aa9b6061f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:53.126478 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7248321-1cd9-4aed-a732-be0aa9b6061f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:53.148104 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-c7248321-1cd9-4aed-a732-be0aa9b6061f None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:53.149310 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-c7248321-1cd9-4aed-a732-be0aa9b6061f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:53.157281 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 527/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:38:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:53.313819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be42f-fd1c-4c70-8b9e-48e97d6229d8 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:53.330224 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be42f-fd1c-4c70-8b9e-48e97d6229d8 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:53.335565 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea95ebe-c642-49de-845b-d81904e68c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:53.336167 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea95ebe-c642-49de-845b-d81904e68c3f service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:53.336445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea95ebe-c642-49de-845b-d81904e68c3f service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:53.336714 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea95ebe-c642-49de-845b-d81904e68c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:53.345810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea95ebe-c642-49de-845b-d81904e68c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:53.347434 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea95ebe-c642-49de-845b-d81904e68c3f service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:53.359587 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 530/1057] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:55.479124 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ee0b0-ecc2-433f-b641-ea401db4c092 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:55.479648 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ee0b0-ecc2-433f-b641-ea401db4c092 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:55.479648 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ee0b0-ecc2-433f-b641-ea401db4c092 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:55.481036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 528/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:55.486856 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a9ccd-f23a-4ffc-afb5-05e8c18da5df None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:55.487258 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a9ccd-f23a-4ffc-afb5-05e8c18da5df None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:55.487408 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a9ccd-f23a-4ffc-afb5-05e8c18da5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:55.506504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-893a9ccd-f23a-4ffc-afb5-05e8c18da5df None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:55.507681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-893a9ccd-f23a-4ffc-afb5-05e8c18da5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:55.515239 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 531/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:38:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:55.859852 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ee0b0-ecc2-433f-b641-ea401db4c092 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:55.870748 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ee0b0-ecc2-433f-b641-ea401db4c092 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:55.874223 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33156dda-7d59-4c66-b95f-6fbebb00f1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:55.874807 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33156dda-7d59-4c66-b95f-6fbebb00f1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:55.875085 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33156dda-7d59-4c66-b95f-6fbebb00f1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:55.875356 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33156dda-7d59-4c66-b95f-6fbebb00f1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:55.884019 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33156dda-7d59-4c66-b95f-6fbebb00f1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:55.885501 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33156dda-7d59-4c66-b95f-6fbebb00f1a7 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:55.894831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 529/1060] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:38:58.287124 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009cef-e8ad-4664-90d8-3a9f4bf4750a None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:58.287676 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009cef-e8ad-4664-90d8-3a9f4bf4750a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:58.287676 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009cef-e8ad-4664-90d8-3a9f4bf4750a None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:58.289057 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 532/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:38:58.294288 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c6a2-badb-4c22-95ee-2fd8c6856776 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:58.294701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c6a2-badb-4c22-95ee-2fd8c6856776 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:58.294830 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c6a2-badb-4c22-95ee-2fd8c6856776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:58.314783 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-53c9c6a2-badb-4c22-95ee-2fd8c6856776 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:38:58.315970 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-53c9c6a2-badb-4c22-95ee-2fd8c6856776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:38:58.323466 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 530/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:38:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:38:58.663653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67009cef-e8ad-4664-90d8-3a9f4bf4750a None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:38:58.674810 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67009cef-e8ad-4664-90d8-3a9f4bf4750a None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:38:58.678285 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34038846-ff8b-49df-876e-3194764174ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:38:58.678875 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34038846-ff8b-49df-876e-3194764174ab service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:38:58.679152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34038846-ff8b-49df-876e-3194764174ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:38:58.679422 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34038846-ff8b-49df-876e-3194764174ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:38:58.688389 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34038846-ff8b-49df-876e-3194764174ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:38:58.690489 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34038846-ff8b-49df-876e-3194764174ab service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:38:58.699565 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 533/1063] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:38:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:01.248093 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dae79-464e-4150-b7aa-f8e5bf4becdd None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:01.248600 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dae79-464e-4150-b7aa-f8e5bf4becdd None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:01.248600 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dae79-464e-4150-b7aa-f8e5bf4becdd None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:01.249908 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 531/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:39:01.255067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc0fb-add1-449e-b7d5-2794dbf08e57 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:01.255486 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc0fb-add1-449e-b7d5-2794dbf08e57 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:01.255617 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc0fb-add1-449e-b7d5-2794dbf08e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:01.274135 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-7e9cc0fb-add1-449e-b7d5-2794dbf08e57 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:01.275314 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-7e9cc0fb-add1-449e-b7d5-2794dbf08e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:01.283440 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 534/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:39:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:39:01.625146 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dae79-464e-4150-b7aa-f8e5bf4becdd None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:01.635840 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dae79-464e-4150-b7aa-f8e5bf4becdd None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:01.639274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38c3d5-9433-467a-93d7-8e8c57485d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:01.639849 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38c3d5-9433-467a-93d7-8e8c57485d53 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:01.640121 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38c3d5-9433-467a-93d7-8e8c57485d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:01.640387 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38c3d5-9433-467a-93d7-8e8c57485d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:01.649790 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38c3d5-9433-467a-93d7-8e8c57485d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:01.651209 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38c3d5-9433-467a-93d7-8e8c57485d53 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:01.660893 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 532/1066] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:03.978037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5927b-96cc-4bef-894d-0381bc7f4adf None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:03.978574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5927b-96cc-4bef-894d-0381bc7f4adf None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:03.978574 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5927b-96cc-4bef-894d-0381bc7f4adf None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:03.979922 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 535/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:03.985208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf766c2-5a95-4e7b-9bce-8903dd058d48 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:03.985614 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf766c2-5a95-4e7b-9bce-8903dd058d48 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:03.985752 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf766c2-5a95-4e7b-9bce-8903dd058d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:04.004908 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-4bf766c2-5a95-4e7b-9bce-8903dd058d48 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:04.006095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-4bf766c2-5a95-4e7b-9bce-8903dd058d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:04.013721 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 533/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:39:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:39:04.358274 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5927b-96cc-4bef-894d-0381bc7f4adf None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:04.368757 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5927b-96cc-4bef-894d-0381bc7f4adf None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:04.372222 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11deb49-7c57-4fd5-ae97-b5c840bd10d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:04.372841 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11deb49-7c57-4fd5-ae97-b5c840bd10d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:04.373389 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11deb49-7c57-4fd5-ae97-b5c840bd10d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:04.373389 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11deb49-7c57-4fd5-ae97-b5c840bd10d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:04.381954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11deb49-7c57-4fd5-ae97-b5c840bd10d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:04.383405 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11deb49-7c57-4fd5-ae97-b5c840bd10d9 service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:04.393090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 536/1069] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:06.720976 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5336bd-ef0b-45bb-aa5d-2e0dcb69eaaa None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:06.721534 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5336bd-ef0b-45bb-aa5d-2e0dcb69eaaa None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:06.721534 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5336bd-ef0b-45bb-aa5d-2e0dcb69eaaa None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:06.722873 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 534/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:06.728065 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8b136-1193-4c6a-8b11-24964ad16a47 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:06.728478 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8b136-1193-4c6a-8b11-24964ad16a47 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:06.728626 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8b136-1193-4c6a-8b11-24964ad16a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:06.747868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-8ab8b136-1193-4c6a-8b11-24964ad16a47 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:06.749081 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-8ab8b136-1193-4c6a-8b11-24964ad16a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:06.756874 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 537/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:39:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:39:07.091608 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5336bd-ef0b-45bb-aa5d-2e0dcb69eaaa None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:07.102309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5336bd-ef0b-45bb-aa5d-2e0dcb69eaaa None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:07.105751 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4c7d8-2048-4bf8-bed0-c81711d2a992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:07.106329 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4c7d8-2048-4bf8-bed0-c81711d2a992 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:07.106599 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4c7d8-2048-4bf8-bed0-c81711d2a992 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:07.106890 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4c7d8-2048-4bf8-bed0-c81711d2a992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:07.115508 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4c7d8-2048-4bf8-bed0-c81711d2a992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:07.116927 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4c7d8-2048-4bf8-bed0-c81711d2a992 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:07.125855 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 535/1072] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:09.338055 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f555-2940-4a64-bcaa-090b2dddc252 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:09.338617 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f555-2940-4a64-bcaa-090b2dddc252 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:09.338617 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358f555-2940-4a64-bcaa-090b2dddc252 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:09.339817 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 538/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:09.345609 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ea595-97ad-4ea8-8449-83d4f3936172 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:09.353745 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ea595-97ad-4ea8-8449-83d4f3936172 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:09.353745 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ea595-97ad-4ea8-8449-83d4f3936172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:09.365618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-719ea595-97ad-4ea8-8449-83d4f3936172 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:09.366808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-719ea595-97ad-4ea8-8449-83d4f3936172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:09.374571 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 536/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:39:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:39:09.711389 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358f555-2940-4a64-bcaa-090b2dddc252 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:09.716710 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=64 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:39:09.722884 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358f555-2940-4a64-bcaa-090b2dddc252 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:09.726348 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36b428-e1ed-4e39-86a8-47b342609b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:09.736846 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36b428-e1ed-4e39-86a8-47b342609b7a service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:09.736846 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36b428-e1ed-4e39-86a8-47b342609b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:09.736846 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36b428-e1ed-4e39-86a8-47b342609b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:09.736846 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36b428-e1ed-4e39-86a8-47b342609b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:09.737526 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36b428-e1ed-4e39-86a8-47b342609b7a service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:09.746725 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 539/1075] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:12.038717 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d299-0195-4467-8c24-1b254746541c None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:12.039294 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d299-0195-4467-8c24-1b254746541c None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:12.039294 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d299-0195-4467-8c24-1b254746541c None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:12.040593 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 537/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:12.045830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20771be5-5672-4830-b04d-1496a78c5156 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:12.046251 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20771be5-5672-4830-b04d-1496a78c5156 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:12.046350 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20771be5-5672-4830-b04d-1496a78c5156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:12.064876 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-20771be5-5672-4830-b04d-1496a78c5156 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:12.066042 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-20771be5-5672-4830-b04d-1496a78c5156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:12.073590 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 540/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:39:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:39:12.426521 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d299-0195-4467-8c24-1b254746541c None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:12.431897 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=73 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:39:12.437838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d299-0195-4467-8c24-1b254746541c None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:12.441865 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9475f-3892-4208-8524-efd7a6311842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:12.444073 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9475f-3892-4208-8524-efd7a6311842 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:12.444073 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9475f-3892-4208-8524-efd7a6311842 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:12.444073 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9475f-3892-4208-8524-efd7a6311842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:12.451824 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9475f-3892-4208-8524-efd7a6311842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:12.453325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9475f-3892-4208-8524-efd7a6311842 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:12.463031 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 538/1078] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:14.693927 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c39c0-b01f-4ca2-aec2-18a4fdd9db48 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:14.694435 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c39c0-b01f-4ca2-aec2-18a4fdd9db48 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:14.694435 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c39c0-b01f-4ca2-aec2-18a4fdd9db48 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:14.695685 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 541/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:14.700944 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62033136-fa38-4c12-87c4-7890a5d75b7e None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:14.701333 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62033136-fa38-4c12-87c4-7890a5d75b7e None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:14.701496 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62033136-fa38-4c12-87c4-7890a5d75b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:14.719802 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-62033136-fa38-4c12-87c4-7890a5d75b7e None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:14.721533 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-62033136-fa38-4c12-87c4-7890a5d75b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:14.729020 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 539/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:39:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:39:15.070493 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c39c0-b01f-4ca2-aec2-18a4fdd9db48 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:15.081723 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c39c0-b01f-4ca2-aec2-18a4fdd9db48 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:15.085159 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666482-82ba-40c3-be35-a7d1b3a2f28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:15.085746 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666482-82ba-40c3-be35-a7d1b3a2f28d service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:15.086017 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666482-82ba-40c3-be35-a7d1b3a2f28d service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:15.086285 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666482-82ba-40c3-be35-a7d1b3a2f28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:15.095071 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666482-82ba-40c3-be35-a7d1b3a2f28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:15.097200 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666482-82ba-40c3-be35-a7d1b3a2f28d service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:15.106306 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 542/1081] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:17.294168 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5fdb-21a5-4bdc-8d9e-3f7b73002ea8 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:17.294728 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5fdb-21a5-4bdc-8d9e-3f7b73002ea8 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:17.294728 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5fdb-21a5-4bdc-8d9e-3f7b73002ea8 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:17.295967 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 540/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:17.301843 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d01b-8e9d-4e52-845f-9a217a6ac356 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:17.302270 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d01b-8e9d-4e52-845f-9a217a6ac356 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:17.302406 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d01b-8e9d-4e52-845f-9a217a6ac356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:17.322191 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-5ee2d01b-8e9d-4e52-845f-9a217a6ac356 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:17.323424 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-5ee2d01b-8e9d-4e52-845f-9a217a6ac356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:17.331159 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 543/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:39:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:39:17.676277 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab5fdb-21a5-4bdc-8d9e-3f7b73002ea8 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:17.687102 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab5fdb-21a5-4bdc-8d9e-3f7b73002ea8 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:17.690879 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39370d98-94b6-4583-8190-77fd1797cd96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:17.691458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370d98-94b6-4583-8190-77fd1797cd96 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:17.691734 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370d98-94b6-4583-8190-77fd1797cd96 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:17.692006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370d98-94b6-4583-8190-77fd1797cd96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:17.700642 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39370d98-94b6-4583-8190-77fd1797cd96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:17.702085 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39370d98-94b6-4583-8190-77fd1797cd96 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:17.711508 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 541/1084] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:19.876368 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949804a6-a0de-43e9-9d9e-de0d6d192ae3 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:19.876944 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949804a6-a0de-43e9-9d9e-de0d6d192ae3 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:19.876944 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949804a6-a0de-43e9-9d9e-de0d6d192ae3 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:19.878236 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 544/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:39:19.883425 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833b4c-d867-4d8a-84bc-ca98ff330904 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:19.883819 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833b4c-d867-4d8a-84bc-ca98ff330904 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:19.883970 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833b4c-d867-4d8a-84bc-ca98ff330904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:19.902568 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-a4833b4c-d867-4d8a-84bc-ca98ff330904 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:19.903747 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-a4833b4c-d867-4d8a-84bc-ca98ff330904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:19.911867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 542/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:39:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:39:20.251073 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949804a6-a0de-43e9-9d9e-de0d6d192ae3 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:20.261418 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949804a6-a0de-43e9-9d9e-de0d6d192ae3 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:20.264819 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74944ae2-c703-4cf3-ae9b-5f3bfd99e58c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:20.265399 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74944ae2-c703-4cf3-ae9b-5f3bfd99e58c service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:20.265671 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74944ae2-c703-4cf3-ae9b-5f3bfd99e58c service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:20.265934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74944ae2-c703-4cf3-ae9b-5f3bfd99e58c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:20.274875 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74944ae2-c703-4cf3-ae9b-5f3bfd99e58c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:20.276279 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74944ae2-c703-4cf3-ae9b-5f3bfd99e58c service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:20.285828 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 545/1087] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:29.897856 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=17 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:39:30.281374 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=23 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:39:44.397998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc3686-08a9-47ea-9b39-04941806cac7 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:44.398618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc3686-08a9-47ea-9b39-04941806cac7 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:44.398618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc3686-08a9-47ea-9b39-04941806cac7 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:44.399855 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 543/1088] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:44.405074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c26db-7b2d-4d34-bb32-bee39f539df1 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:44.405505 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c26db-7b2d-4d34-bb32-bee39f539df1 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:44.405607 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c26db-7b2d-4d34-bb32-bee39f539df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:44.425134 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-e45c26db-7b2d-4d34-bb32-bee39f539df1 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:44.427503 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-e45c26db-7b2d-4d34-bb32-bee39f539df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:44.436790 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 546/1089] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:39:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:39:44.789860 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef080d24-5d31-4ea3-92e8-164f9148f64a None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:44.790142 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef080d24-5d31-4ea3-92e8-164f9148f64a None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:44.790701 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef080d24-5d31-4ea3-92e8-164f9148f64a None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:44.792041 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 544/1090] 10.222.0.27 () {54 vars in 967 bytes} [Fri Aug 19 17:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:44.797303 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff73ecf-ddd2-4f0f-a8d0-8a99a7b74c40 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:44.798143 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff73ecf-ddd2-4f0f-a8d0-8a99a7b74c40 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:44.798415 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff73ecf-ddd2-4f0f-a8d0-8a99a7b74c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:44.817885 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-1ff73ecf-ddd2-4f0f-a8d0-8a99a7b74c40 None None] MFA Rules not processed for user `fbe5b4476e8e413f8d409c8e73c4c4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:44.819040 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-1ff73ecf-ddd2-4f0f-a8d0-8a99a7b74c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:44.825211 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 547/1091] 10.222.0.27 () {58 vars in 1064 bytes} [Fri Aug 19 17:39:44 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:39:44.832385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef080d24-5d31-4ea3-92e8-164f9148f64a None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:44.842875 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef080d24-5d31-4ea3-92e8-164f9148f64a None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:44.846327 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706ec4e-fb1f-4ae7-9783-13a710c4ba57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe5b4476e8e413f8d409c8e73c4c4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:44.846895 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706ec4e-fb1f-4ae7-9783-13a710c4ba57 service glance] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:44.847167 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706ec4e-fb1f-4ae7-9783-13a710c4ba57 service glance] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:44.847437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706ec4e-fb1f-4ae7-9783-13a710c4ba57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:44.856054 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706ec4e-fb1f-4ae7-9783-13a710c4ba57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:44.857492 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706ec4e-fb1f-4ae7-9783-13a710c4ba57 service glance] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:44.867006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 545/1092] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:47.115059 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11348e-e13e-4070-a8e9-59a3e0f54a61 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:47.115613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11348e-e13e-4070-a8e9-59a3e0f54a61 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:47.115613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11348e-e13e-4070-a8e9-59a3e0f54a61 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:47.116998 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 548/1093] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:47.122256 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60caf7-4de0-4412-951f-4efcb4eb6ce0 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:47.122686 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60caf7-4de0-4412-951f-4efcb4eb6ce0 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:47.122808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60caf7-4de0-4412-951f-4efcb4eb6ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:47.142214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-5c60caf7-4de0-4412-951f-4efcb4eb6ce0 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:47.143419 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-5c60caf7-4de0-4412-951f-4efcb4eb6ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:47.151095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 546/1094] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:39:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:39:47.477005 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11348e-e13e-4070-a8e9-59a3e0f54a61 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:47.489959 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11348e-e13e-4070-a8e9-59a3e0f54a61 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:47.494370 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3dd85a-881a-42fc-99dc-a0db99000533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:47.494958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dd85a-881a-42fc-99dc-a0db99000533 admin admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:47.495236 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dd85a-881a-42fc-99dc-a0db99000533 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:47.495508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dd85a-881a-42fc-99dc-a0db99000533 admin admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:47.496144 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3dd85a-881a-42fc-99dc-a0db99000533 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:47.497974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: WARNING py.warnings [None req-1b3dd85a-881a-42fc-99dc-a0db99000533 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:39:47.497974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: warnings.warn(msg) Aug 19 17:39:47.497974 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: Aug 19 17:39:47.499113 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3dd85a-881a-42fc-99dc-a0db99000533 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:47.516403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 549/1095] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 19 17:39:47 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:39:49.692328 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d32c81-97a3-4f0f-b352-0bcc00e32dac None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:49.692885 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d32c81-97a3-4f0f-b352-0bcc00e32dac None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:49.692885 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d32c81-97a3-4f0f-b352-0bcc00e32dac None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:49.694149 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 547/1096] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:49.699327 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053781d-ced7-4519-aacc-a06d3a1be8e3 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:49.699746 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053781d-ced7-4519-aacc-a06d3a1be8e3 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:49.699856 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053781d-ced7-4519-aacc-a06d3a1be8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:49.719005 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-6053781d-ced7-4519-aacc-a06d3a1be8e3 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:49.720461 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-6053781d-ced7-4519-aacc-a06d3a1be8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:49.727984 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 550/1097] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:39:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:39:50.080571 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d32c81-97a3-4f0f-b352-0bcc00e32dac None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:50.094056 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d32c81-97a3-4f0f-b352-0bcc00e32dac None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:50.098996 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b9429-e6d2-4037-877f-22f60cc68a65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:50.099569 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b9429-e6d2-4037-877f-22f60cc68a65 service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:50.099841 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b9429-e6d2-4037-877f-22f60cc68a65 service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:50.100107 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b9429-e6d2-4037-877f-22f60cc68a65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:50.107980 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b9429-e6d2-4037-877f-22f60cc68a65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:50.109572 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b9429-e6d2-4037-877f-22f60cc68a65 service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:50.119502 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 548/1098] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:52.469740 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bec20c-5bec-4912-a2f0-c4b5f884134a None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:52.470194 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bec20c-5bec-4912-a2f0-c4b5f884134a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:52.470290 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bec20c-5bec-4912-a2f0-c4b5f884134a None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:52.471589 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 551/1099] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:52.476659 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc9946-3528-4204-ac2f-5a90e423d4f7 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:52.477117 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc9946-3528-4204-ac2f-5a90e423d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:52.477223 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc9946-3528-4204-ac2f-5a90e423d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:52.496150 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-17bc9946-3528-4204-ac2f-5a90e423d4f7 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:52.497381 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-17bc9946-3528-4204-ac2f-5a90e423d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:52.505506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 549/1100] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:39:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:39:52.847546 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bec20c-5bec-4912-a2f0-c4b5f884134a None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:52.858477 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bec20c-5bec-4912-a2f0-c4b5f884134a None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:52.862541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3484dc8-fbe7-48de-a130-a5a490c2cd48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:52.863128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3484dc8-fbe7-48de-a130-a5a490c2cd48 service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:52.863405 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3484dc8-fbe7-48de-a130-a5a490c2cd48 service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:52.863678 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3484dc8-fbe7-48de-a130-a5a490c2cd48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:52.872346 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3484dc8-fbe7-48de-a130-a5a490c2cd48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:52.873808 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3484dc8-fbe7-48de-a130-a5a490c2cd48 service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:52.883041 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 552/1101] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:55.136605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ff326-7fe8-48fd-abe9-932ad71b694b None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:55.137156 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ff326-7fe8-48fd-abe9-932ad71b694b None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:55.137156 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ff326-7fe8-48fd-abe9-932ad71b694b None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:55.138481 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 550/1102] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:55.144219 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166ef5e-b319-4280-b582-563cb1469258 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:55.144616 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166ef5e-b319-4280-b582-563cb1469258 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:55.144710 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166ef5e-b319-4280-b582-563cb1469258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:55.163146 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-e166ef5e-b319-4280-b582-563cb1469258 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:55.164328 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-e166ef5e-b319-4280-b582-563cb1469258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:55.171951 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 553/1103] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:39:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:39:55.518262 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ff326-7fe8-48fd-abe9-932ad71b694b None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:55.528972 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ff326-7fe8-48fd-abe9-932ad71b694b None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:55.532406 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ab364-c481-4ea4-805e-9c2675152404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:55.533014 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ab364-c481-4ea4-805e-9c2675152404 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:55.533291 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ab364-c481-4ea4-805e-9c2675152404 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:55.533558 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ab364-c481-4ea4-805e-9c2675152404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:55.542321 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ab364-c481-4ea4-805e-9c2675152404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:55.543740 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ab364-c481-4ea4-805e-9c2675152404 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:55.553394 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 551/1104] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:39:57.801305 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfb4b1-666d-43fe-b8de-d9f10ef21cae None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:57.801832 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfb4b1-666d-43fe-b8de-d9f10ef21cae None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:57.801832 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfb4b1-666d-43fe-b8de-d9f10ef21cae None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:57.803069 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 554/1105] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:39:57.808414 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d53ed7-98d0-498d-b4d0-b33b86cf7ffe None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:57.808849 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d53ed7-98d0-498d-b4d0-b33b86cf7ffe None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:57.808999 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d53ed7-98d0-498d-b4d0-b33b86cf7ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:57.827579 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-56d53ed7-98d0-498d-b4d0-b33b86cf7ffe None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:39:57.833825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-56d53ed7-98d0-498d-b4d0-b33b86cf7ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:39:57.837206 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 552/1106] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:39:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:39:58.191711 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfb4b1-666d-43fe-b8de-d9f10ef21cae None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:39:58.202410 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfb4b1-666d-43fe-b8de-d9f10ef21cae None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:39:58.207260 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da666e-1ef2-41a6-aebb-e33ac6ba9bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:39:58.207260 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da666e-1ef2-41a6-aebb-e33ac6ba9bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:39:58.207484 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da666e-1ef2-41a6-aebb-e33ac6ba9bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:39:58.207715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da666e-1ef2-41a6-aebb-e33ac6ba9bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:39:58.216650 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da666e-1ef2-41a6-aebb-e33ac6ba9bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:39:58.218109 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da666e-1ef2-41a6-aebb-e33ac6ba9bc3 service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:39:58.227508 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 555/1107] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:39:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:40:00.777553 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d061dec-4eed-47c4-952f-cf7e7cdc13f4 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:40:00.778075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d061dec-4eed-47c4-952f-cf7e7cdc13f4 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:40:00.778075 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d061dec-4eed-47c4-952f-cf7e7cdc13f4 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:40:00.779350 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 553/1108] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 19 17:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:40:00.785095 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557cd2a-75b9-4332-b05d-ea8ed63bba2e None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:40:00.785503 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557cd2a-75b9-4332-b05d-ea8ed63bba2e None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:40:00.785643 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557cd2a-75b9-4332-b05d-ea8ed63bba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:40:00.804331 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-8557cd2a-75b9-4332-b05d-ea8ed63bba2e None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:40:00.805522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-8557cd2a-75b9-4332-b05d-ea8ed63bba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:40:00.813349 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 556/1109] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 19 17:40:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:40:01.170565 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d061dec-4eed-47c4-952f-cf7e7cdc13f4 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:40:01.181232 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d061dec-4eed-47c4-952f-cf7e7cdc13f4 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:40:01.185053 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c2be9-1449-4634-a261-89d93b4dbb1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:40:01.185636 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c2be9-1449-4634-a261-89d93b4dbb1b service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:40:01.185915 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c2be9-1449-4634-a261-89d93b4dbb1b service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:40:01.186188 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c2be9-1449-4634-a261-89d93b4dbb1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:40:01.195367 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c2be9-1449-4634-a261-89d93b4dbb1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:40:01.196810 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c2be9-1449-4634-a261-89d93b4dbb1b service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:40:01.206609 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 554/1110] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:40:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:40:10.799751 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=33 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:40:11.201928 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=33 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:41:44.125194 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16af11-20eb-485e-8b0b-5d1b5107358c None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:44.125837 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16af11-20eb-485e-8b0b-5d1b5107358c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:44.125837 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16af11-20eb-485e-8b0b-5d1b5107358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:44.151715 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-7a16af11-20eb-485e-8b0b-5d1b5107358c None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:41:44.153492 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-7a16af11-20eb-485e-8b0b-5d1b5107358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:41:44.163869 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 557/1111] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:41:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:41:44.171833 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19720518-da70-459e-8aba-767ef5a46366 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:44.172338 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19720518-da70-459e-8aba-767ef5a46366 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:44.172444 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19720518-da70-459e-8aba-767ef5a46366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:44.192554 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-19720518-da70-459e-8aba-767ef5a46366 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:41:44.193868 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-19720518-da70-459e-8aba-767ef5a46366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:41:44.202059 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 555/1112] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:41:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:41:44.206515 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16af11-20eb-485e-8b0b-5d1b5107358c None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:41:44.216482 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16af11-20eb-485e-8b0b-5d1b5107358c None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:41:44.220901 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d827d-daa7-448a-89cb-c5aaefaccdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:41:44.221488 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d827d-daa7-448a-89cb-c5aaefaccdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:44.221765 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d827d-daa7-448a-89cb-c5aaefaccdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:44.222036 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d827d-daa7-448a-89cb-c5aaefaccdc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:44.222701 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d827d-daa7-448a-89cb-c5aaefaccdc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:41:44.222997 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d827d-daa7-448a-89cb-c5aaefaccdc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:41:44.223987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: WARNING py.warnings [None req-577d827d-daa7-448a-89cb-c5aaefaccdc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:41:44.223987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: warnings.warn(msg) Aug 19 17:41:44.223987 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: Aug 19 17:41:44.224912 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d827d-daa7-448a-89cb-c5aaefaccdc5 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:41:44.238442 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 558/1113] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 19 17:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:41:44.246590 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19720518-da70-459e-8aba-767ef5a46366 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:41:44.255580 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19720518-da70-459e-8aba-767ef5a46366 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:41:44.260713 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baad0d0-bb9f-4069-977e-39b75a001878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:41:44.261328 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad0d0-bb9f-4069-977e-39b75a001878 admin admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:44.261605 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad0d0-bb9f-4069-977e-39b75a001878 admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:44.261874 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad0d0-bb9f-4069-977e-39b75a001878 admin admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:44.262483 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baad0d0-bb9f-4069-977e-39b75a001878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:41:44.264275 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: WARNING py.warnings [None req-3baad0d0-bb9f-4069-977e-39b75a001878 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:41:44.264275 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: warnings.warn(msg) Aug 19 17:41:44.264275 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: Aug 19 17:41:44.265515 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baad0d0-bb9f-4069-977e-39b75a001878 admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:41:44.379241 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 556/1114] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 19 17:41:44 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:41:44.383969 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d827d-daa7-448a-89cb-c5aaefaccdc5 admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:41:44.393927 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d827d-daa7-448a-89cb-c5aaefaccdc5 admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:41:44.449591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0af039-e2ab-464f-b578-438d08c09b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:41:44.450189 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af039-e2ab-464f-b578-438d08c09b9b admin admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:44.450468 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af039-e2ab-464f-b578-438d08c09b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:44.450761 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af039-e2ab-464f-b578-438d08c09b9b admin admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:44.451379 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af039-e2ab-464f-b578-438d08c09b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:41:44.452372 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: WARNING py.warnings [None req-ad0af039-e2ab-464f-b578-438d08c09b9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:41:44.452372 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: warnings.warn(msg) Aug 19 17:41:44.452372 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: Aug 19 17:41:44.453617 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af039-e2ab-464f-b578-438d08c09b9b admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:41:44.561447 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 559/1115] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 19 17:41:44 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:41:44.565620 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baad0d0-bb9f-4069-977e-39b75a001878 admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:41:44.576278 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baad0d0-bb9f-4069-977e-39b75a001878 admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:41:44.580686 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff131c39-af29-45b6-8cf5-0a168a4ecb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:41:44.581296 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff131c39-af29-45b6-8cf5-0a168a4ecb19 admin admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:44.581572 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff131c39-af29-45b6-8cf5-0a168a4ecb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:44.581838 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff131c39-af29-45b6-8cf5-0a168a4ecb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:44.582529 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff131c39-af29-45b6-8cf5-0a168a4ecb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:41:44.583518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: WARNING py.warnings [None req-ff131c39-af29-45b6-8cf5-0a168a4ecb19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:41:44.583518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: warnings.warn(msg) Aug 19 17:41:44.583518 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: Aug 19 17:41:44.584392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff131c39-af29-45b6-8cf5-0a168a4ecb19 admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:41:44.597633 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 557/1116] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 19 17:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:41:44.601436 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0af039-e2ab-464f-b578-438d08c09b9b admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:41:44.611077 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0af039-e2ab-464f-b578-438d08c09b9b admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:41:44.615502 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d8bc1-f1f8-4d1e-a89f-9411ce5537f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:41:44.616084 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d8bc1-f1f8-4d1e-a89f-9411ce5537f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:44.616361 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d8bc1-f1f8-4d1e-a89f-9411ce5537f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:44.616631 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d8bc1-f1f8-4d1e-a89f-9411ce5537f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:44.617798 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d8bc1-f1f8-4d1e-a89f-9411ce5537f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:41:44.620744 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: WARNING py.warnings [None req-c59d8bc1-f1f8-4d1e-a89f-9411ce5537f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:41:44.620744 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: warnings.warn(msg) Aug 19 17:41:44.620744 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: Aug 19 17:41:44.622152 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d8bc1-f1f8-4d1e-a89f-9411ce5537f3 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:41:44.637813 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 560/1117] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 19 17:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:41:44.641864 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff131c39-af29-45b6-8cf5-0a168a4ecb19 admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:41:44.651815 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff131c39-af29-45b6-8cf5-0a168a4ecb19 admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:41:44.656223 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d614caf-59c1-4fdc-bb3d-a6810ca8802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:41:44.656889 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d614caf-59c1-4fdc-bb3d-a6810ca8802b admin admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:44.657164 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d614caf-59c1-4fdc-bb3d-a6810ca8802b admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:44.657430 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d614caf-59c1-4fdc-bb3d-a6810ca8802b admin admin] PATH_INFO: `/v3/projects/e6e3674e443d400a9537e7288d5751e0/users/ecfbb531d3894c809abce241df0d165a/roles/f81ebe87e8a74c24a390dbaafdacdbce` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:44.671631 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d614caf-59c1-4fdc-bb3d-a6810ca8802b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e3674e443d400a9537e7288d5751e0, user_id=ecfbb531d3894c809abce241df0d165a, role_id=f81ebe87e8a74c24a390dbaafdacdbce)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:41:44.672637 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: WARNING py.warnings [None req-3d614caf-59c1-4fdc-bb3d-a6810ca8802b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:41:44.672637 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: warnings.warn(msg) Aug 19 17:41:44.672637 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: Aug 19 17:41:44.674620 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d614caf-59c1-4fdc-bb3d-a6810ca8802b admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:41:44.749859 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 558/1118] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 19 17:41:44 2022] PUT /identity/v3/projects/e6e3674e443d400a9537e7288d5751e0/users/ecfbb531d3894c809abce241df0d165a/roles/f81ebe87e8a74c24a390dbaafdacdbce => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 17:41:44.762358 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa39cb-93bc-4528-8576-3343fffa9f4f None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:44.762645 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa39cb-93bc-4528-8576-3343fffa9f4f None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:44.762970 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa39cb-93bc-4528-8576-3343fffa9f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:44.792263 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-2dfa39cb-93bc-4528-8576-3343fffa9f4f None None] MFA Rules not processed for user `ecfbb531d3894c809abce241df0d165a`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:41:44.793498 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-2dfa39cb-93bc-4528-8576-3343fffa9f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:41:44.854767 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 561/1119] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:41:44 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:41:44.868117 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2475335-98da-45fb-ad5b-b0f87b91c1ed None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:44.868396 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2475335-98da-45fb-ad5b-b0f87b91c1ed None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:44.868663 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2475335-98da-45fb-ad5b-b0f87b91c1ed None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:44.870062 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 559/1120] 10.222.0.27 () {54 vars in 964 bytes} [Fri Aug 19 17:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:41:44.874947 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4dd3-5132-4bdf-95f6-dd8e27d8c88a None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:44.875232 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4dd3-5132-4bdf-95f6-dd8e27d8c88a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:44.875505 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4dd3-5132-4bdf-95f6-dd8e27d8c88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:44.895099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-a5bf4dd3-5132-4bdf-95f6-dd8e27d8c88a None None] MFA Rules not processed for user `c0d818956e1048a096830ec372382e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:41:44.896218 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-a5bf4dd3-5132-4bdf-95f6-dd8e27d8c88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:41:44.939327 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:41:44.947384 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 562/1121] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Aug 19 17:41:44 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:41:44.955242 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2475335-98da-45fb-ad5b-b0f87b91c1ed None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:41:44.966113 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2475335-98da-45fb-ad5b-b0f87b91c1ed None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:41:44.969637 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6619734-5f13-42da-a7d6-42fd3ee79ff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d818956e1048a096830ec372382e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:41:44.970214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6619734-5f13-42da-a7d6-42fd3ee79ff2 service cinder] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:44.970489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6619734-5f13-42da-a7d6-42fd3ee79ff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:44.970759 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6619734-5f13-42da-a7d6-42fd3ee79ff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:44.979647 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6619734-5f13-42da-a7d6-42fd3ee79ff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:41:44.981235 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6619734-5f13-42da-a7d6-42fd3ee79ff2 service cinder] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:41:44.989839 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 560/1122] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:41:44 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:41:45.029998 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c96f0-225e-489d-a3e6-771b0ce6dd9e None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:45.030285 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c96f0-225e-489d-a3e6-771b0ce6dd9e None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:45.030558 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c96f0-225e-489d-a3e6-771b0ce6dd9e None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:45.031818 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 563/1123] 10.222.0.27 () {52 vars in 830 bytes} [Fri Aug 19 17:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:41:45.035270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6619734-5f13-42da-a7d6-42fd3ee79ff2 service cinder] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:41:45.098469 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6619734-5f13-42da-a7d6-42fd3ee79ff2 service cinder] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:41:45.103485 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:41:45.104097 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:45.104374 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:45.104646 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] PATH_INFO: `/v3/users/ecfbb531d3894c809abce241df0d165a` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:45.105786 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecfbb531d3894c809abce241df0d165a)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:41:45.106785 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: WARNING py.warnings [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:41:45.106785 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: warnings.warn(msg) Aug 19 17:41:45.106785 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: Aug 19 17:41:45.107986 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:41:45.295460 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecfbb531d3894c809abce241df0d165a'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:41:45.310531 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecfbb531d3894c809abce241df0d165a'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:41:45.311332 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecfbb531d3894c809abce241df0d165a'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:41:45.411676 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecfbb531d3894c809abce241df0d165a'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:41:45.412314 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecfbb531d3894c809abce241df0d165a'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:41:45.435023 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:41:45.442590 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 561/1124] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 19 17:41:45 2022] DELETE /identity/v3/users/ecfbb531d3894c809abce241df0d165a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:41:45.447083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3441bd2-9d8f-461e-b724-f7fdc463f3fa None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:45.447551 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3441bd2-9d8f-461e-b724-f7fdc463f3fa None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:45.447654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3441bd2-9d8f-461e-b724-f7fdc463f3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:45.466266 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-f3441bd2-9d8f-461e-b724-f7fdc463f3fa None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:41:45.467432 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-f3441bd2-9d8f-461e-b724-f7fdc463f3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:41:45.524418 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 564/1125] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:41:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:41:45.534564 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:41:45.535967 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:41:45.603563 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac0793-260c-4ba0-b2e5-94b1bed17c11 admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:41:45.606965 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ed6f3-4bb1-4fbc-9ca0-72228c5c4d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:41:45.607552 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ed6f3-4bb1-4fbc-9ca0-72228c5c4d05 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:45.607825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ed6f3-4bb1-4fbc-9ca0-72228c5c4d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:45.608090 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ed6f3-4bb1-4fbc-9ca0-72228c5c4d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:45.616876 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ed6f3-4bb1-4fbc-9ca0-72228c5c4d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:41:45.618365 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ed6f3-4bb1-4fbc-9ca0-72228c5c4d05 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:41:45.627334 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 562/1126] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:41:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:41:46.082287 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3441bd2-9d8f-461e-b724-f7fdc463f3fa None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:41:46.083796 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-f3441bd2-9d8f-461e-b724-f7fdc463f3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:41:46.095816 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3441bd2-9d8f-461e-b724-f7fdc463f3fa None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:41:46.102644 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:41:46.103389 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:41:46.103673 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:41:46.104484 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] PATH_INFO: `/v3/projects/e6e3674e443d400a9537e7288d5751e0` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:41:46.105128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e3674e443d400a9537e7288d5751e0)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:41:46.106145 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: WARNING py.warnings [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:41:46.106145 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: warnings.warn(msg) Aug 19 17:41:46.106145 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: Aug 19 17:41:46.107349 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:41:46.217444 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e3674e443d400a9537e7288d5751e0', 'request_id': 'req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:41:46.223496 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e3674e443d400a9537e7288d5751e0', 'request_id': 'req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:41:46.315561 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e3674e443d400a9537e7288d5751e0', 'request_id': 'req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:41:46.333249 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] The token cache is being invalidate because project e6e3674e443d400a9537e7288d5751e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 17:41:46.333538 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:41:46.334174 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-1ecdd49c-a8f4-40f0-b67a-d192a16b3b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:41:46.335754 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 565/1127] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 19 17:41:46 2022] DELETE /identity/v3/projects/e6e3674e443d400a9537e7288d5751e0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:41:55.623373 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:DELETE=1,keystone:SELECT=33 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:41:56.330275 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:43:08.231601 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5a3ca-d896-4efb-be9b-07e75adeed36 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:08.232206 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5a3ca-d896-4efb-be9b-07e75adeed36 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:08.232206 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5a3ca-d896-4efb-be9b-07e75adeed36 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:08.233554 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 563/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:43:08.238344 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06673b-fbe2-4e10-afb0-0381c0a65ad0 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:08.238783 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06673b-fbe2-4e10-afb0-0381c0a65ad0 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:08.238895 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06673b-fbe2-4e10-afb0-0381c0a65ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:08.258585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-6c06673b-fbe2-4e10-afb0-0381c0a65ad0 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:43:08.259762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-6c06673b-fbe2-4e10-afb0-0381c0a65ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:08.315762 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 566/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:43:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:43:08.470624 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5a3ca-d896-4efb-be9b-07e75adeed36 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:43:08.472283 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-37f5a3ca-d896-4efb-be9b-07e75adeed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:08.540170 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5a3ca-d896-4efb-be9b-07e75adeed36 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:43:08.544993 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c960c3-b04e-46ae-a0f1-f98118b03f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:43:08.545586 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c960c3-b04e-46ae-a0f1-f98118b03f37 service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:08.545862 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c960c3-b04e-46ae-a0f1-f98118b03f37 service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:08.546126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c960c3-b04e-46ae-a0f1-f98118b03f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:08.554097 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c960c3-b04e-46ae-a0f1-f98118b03f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:43:08.556167 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c960c3-b04e-46ae-a0f1-f98118b03f37 service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:43:08.565635 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 564/1130] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:43:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 17:43:09.393030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61ce69-19d2-47cb-a8f6-4453813134e2 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:09.393566 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61ce69-19d2-47cb-a8f6-4453813134e2 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:09.393566 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61ce69-19d2-47cb-a8f6-4453813134e2 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:09.394789 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 567/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:43:09.399985 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04c676-ce34-4fbb-baa8-7646f4a91bc7 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:09.400432 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04c676-ce34-4fbb-baa8-7646f4a91bc7 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:09.400530 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04c676-ce34-4fbb-baa8-7646f4a91bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:09.420453 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-7e04c676-ce34-4fbb-baa8-7646f4a91bc7 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:43:09.421663 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-7e04c676-ce34-4fbb-baa8-7646f4a91bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:09.429279 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 565/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:43:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:43:09.583904 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61ce69-19d2-47cb-a8f6-4453813134e2 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:43:09.597821 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61ce69-19d2-47cb-a8f6-4453813134e2 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:43:09.602773 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2faf5a-d448-421f-817b-3ca211fad21c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:43:09.603390 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2faf5a-d448-421f-817b-3ca211fad21c service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:09.603671 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2faf5a-d448-421f-817b-3ca211fad21c service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:09.603944 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2faf5a-d448-421f-817b-3ca211fad21c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:09.611851 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2faf5a-d448-421f-817b-3ca211fad21c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:43:09.613458 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2faf5a-d448-421f-817b-3ca211fad21c service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:43:09.622653 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 568/1133] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:43:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:43:14.216238 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec79d2-3557-4d08-8044-f52497aa3613 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:14.216776 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec79d2-3557-4d08-8044-f52497aa3613 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:14.216884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec79d2-3557-4d08-8044-f52497aa3613 None None] PATH_INFO: `/v3` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:14.218135 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 566/1134] 10.222.0.16 () {54 vars in 925 bytes} [Fri Aug 19 17:43:14 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:43:14.224202 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae79ef-76e0-457f-be06-4691ab27f0d1 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:14.224650 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae79ef-76e0-457f-be06-4691ab27f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:14.224785 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae79ef-76e0-457f-be06-4691ab27f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:14.257801 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-27ae79ef-76e0-457f-be06-4691ab27f0d1 None None] MFA Rules not processed for user `82313d212e4f454697849ea186208785`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:43:14.258942 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-27ae79ef-76e0-457f-be06-4691ab27f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:14.318739 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 569/1135] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Aug 19 17:43:14 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:43:19.415542 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=35 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:43:20.839549 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b613-49c2-42cd-8c34-169a5d1f2009 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:20.840755 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b613-49c2-42cd-8c34-169a5d1f2009 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:20.840755 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b613-49c2-42cd-8c34-169a5d1f2009 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:20.842009 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 567/1136] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:43:20.846827 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911ddf0-136f-412a-b8e1-0cd159582661 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:20.847255 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911ddf0-136f-412a-b8e1-0cd159582661 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:20.847375 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911ddf0-136f-412a-b8e1-0cd159582661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:20.866185 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-3911ddf0-136f-412a-b8e1-0cd159582661 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:43:20.867374 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-3911ddf0-136f-412a-b8e1-0cd159582661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:20.875075 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 570/1137] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:43:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:43:21.039222 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506b613-49c2-42cd-8c34-169a5d1f2009 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:43:21.052165 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506b613-49c2-42cd-8c34-169a5d1f2009 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:43:21.057309 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ec9bd-c7b8-4da2-874f-5147a949af31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:43:21.057899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec9bd-c7b8-4da2-874f-5147a949af31 service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:21.058208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec9bd-c7b8-4da2-874f-5147a949af31 service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:21.058477 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ec9bd-c7b8-4da2-874f-5147a949af31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:21.067334 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ec9bd-c7b8-4da2-874f-5147a949af31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:43:21.068968 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ec9bd-c7b8-4da2-874f-5147a949af31 service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:43:21.078871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 568/1138] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:43:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:43:21.901386 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6403a9-be6f-4dc8-a02d-d350bdff4691 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:21.901982 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6403a9-be6f-4dc8-a02d-d350bdff4691 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:21.901982 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6403a9-be6f-4dc8-a02d-d350bdff4691 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:21.903797 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 571/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:43:21.908791 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1ff86-3717-4050-8753-6e2df0f264d9 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:21.909185 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1ff86-3717-4050-8753-6e2df0f264d9 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:21.909343 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1ff86-3717-4050-8753-6e2df0f264d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:21.930703 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-63d1ff86-3717-4050-8753-6e2df0f264d9 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:43:21.931891 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-63d1ff86-3717-4050-8753-6e2df0f264d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:21.939844 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 569/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:43:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:43:22.097686 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6403a9-be6f-4dc8-a02d-d350bdff4691 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:43:22.111187 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6403a9-be6f-4dc8-a02d-d350bdff4691 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:43:22.116053 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9accd1-9ed9-4d4c-902c-684b72ce2eb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:43:22.116641 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9accd1-9ed9-4d4c-902c-684b72ce2eb8 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:22.116950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9accd1-9ed9-4d4c-902c-684b72ce2eb8 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:22.117219 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9accd1-9ed9-4d4c-902c-684b72ce2eb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:22.125760 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9accd1-9ed9-4d4c-902c-684b72ce2eb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:43:22.127350 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9accd1-9ed9-4d4c-902c-684b72ce2eb8 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:43:22.137617 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 572/1141] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:43:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:43:23.579401 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eae00b-93d5-4e09-896a-f911d036e7c2 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:23.579921 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eae00b-93d5-4e09-896a-f911d036e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:23.579921 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eae00b-93d5-4e09-896a-f911d036e7c2 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:23.581320 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 570/1142] 10.222.0.27 () {54 vars in 961 bytes} [Fri Aug 19 17:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:43:23.586564 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ad833-d1e8-498d-a938-88fac822a86d None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:23.586986 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ad833-d1e8-498d-a938-88fac822a86d None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:23.587105 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ad833-d1e8-498d-a938-88fac822a86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:23.606466 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-df7ad833-d1e8-498d-a938-88fac822a86d None None] MFA Rules not processed for user `82313d212e4f454697849ea186208785`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:43:23.607626 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-df7ad833-d1e8-498d-a938-88fac822a86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:23.616898 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 573/1143] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Aug 19 17:43:23 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:43:23.624177 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eae00b-93d5-4e09-896a-f911d036e7c2 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:43:23.637407 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eae00b-93d5-4e09-896a-f911d036e7c2 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:43:23.642781 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6768e06-65ee-4290-b61e-692afef7dfb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82313d212e4f454697849ea186208785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:43:23.643358 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6768e06-65ee-4290-b61e-692afef7dfb0 service placement] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:23.643636 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6768e06-65ee-4290-b61e-692afef7dfb0 service placement] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:23.643907 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6768e06-65ee-4290-b61e-692afef7dfb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:23.651808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6768e06-65ee-4290-b61e-692afef7dfb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:43:23.654025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6768e06-65ee-4290-b61e-692afef7dfb0 service placement] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:43:23.663294 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 571/1144] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:43:23 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:43:33.363950 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389543-5995-4021-a11f-1d9814a75b8c None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:33.364510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389543-5995-4021-a11f-1d9814a75b8c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:33.364510 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389543-5995-4021-a11f-1d9814a75b8c None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:33.365980 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 574/1145] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:43:33.370697 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7001d4-f51a-4954-847f-7537081c7e13 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:33.371107 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7001d4-f51a-4954-847f-7537081c7e13 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:33.371221 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7001d4-f51a-4954-847f-7537081c7e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:33.389797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-4d7001d4-f51a-4954-847f-7537081c7e13 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:43:33.390962 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-4d7001d4-f51a-4954-847f-7537081c7e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:33.398390 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 572/1146] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:43:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:43:33.556893 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389543-5995-4021-a11f-1d9814a75b8c None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:43:33.570743 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389543-5995-4021-a11f-1d9814a75b8c None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:43:33.575554 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905044e6-9970-481c-b056-6f0664ce2384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:43:33.576197 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905044e6-9970-481c-b056-6f0664ce2384 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:33.576602 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905044e6-9970-481c-b056-6f0664ce2384 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:33.576776 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905044e6-9970-481c-b056-6f0664ce2384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:33.584873 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905044e6-9970-481c-b056-6f0664ce2384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:43:33.586452 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905044e6-9970-481c-b056-6f0664ce2384 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:43:33.596296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 575/1147] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:43:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:43:34.429155 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb583717-a402-469a-b234-3b9f72c6c883 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:34.429617 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb583717-a402-469a-b234-3b9f72c6c883 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:34.429728 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb583717-a402-469a-b234-3b9f72c6c883 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:34.431006 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 573/1148] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:43:34.435742 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c18af5-0eaf-4037-83a2-54153ec67369 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:34.437109 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c18af5-0eaf-4037-83a2-54153ec67369 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:34.437225 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c18af5-0eaf-4037-83a2-54153ec67369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:34.455632 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-31c18af5-0eaf-4037-83a2-54153ec67369 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:43:34.456839 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-31c18af5-0eaf-4037-83a2-54153ec67369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:34.464277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 576/1149] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:43:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:43:34.622008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb583717-a402-469a-b234-3b9f72c6c883 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:43:34.635944 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb583717-a402-469a-b234-3b9f72c6c883 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:43:34.640808 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174062a-5b8a-421b-b64d-552b305e30d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:43:34.641383 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174062a-5b8a-421b-b64d-552b305e30d9 service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:34.641656 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174062a-5b8a-421b-b64d-552b305e30d9 service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:34.641918 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174062a-5b8a-421b-b64d-552b305e30d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:34.649908 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174062a-5b8a-421b-b64d-552b305e30d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:43:34.651467 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174062a-5b8a-421b-b64d-552b305e30d9 service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:43:34.660632 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 574/1150] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:43:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:43:39.036847 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a1bbe-5b16-4dae-87d4-fe9547639a74 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:39.037411 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a1bbe-5b16-4dae-87d4-fe9547639a74 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:39.037411 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a1bbe-5b16-4dae-87d4-fe9547639a74 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:39.038792 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 577/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:43:39.043925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554089e-aaf3-43f5-9124-abf4c5cdfd21 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:39.044372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554089e-aaf3-43f5-9124-abf4c5cdfd21 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:39.044466 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554089e-aaf3-43f5-9124-abf4c5cdfd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:39.063447 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-2554089e-aaf3-43f5-9124-abf4c5cdfd21 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:43:39.064636 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-2554089e-aaf3-43f5-9124-abf4c5cdfd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:39.072299 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 575/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:43:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:43:39.416584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a1bbe-5b16-4dae-87d4-fe9547639a74 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:43:39.418541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-f84a1bbe-5b16-4dae-87d4-fe9547639a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:39.425468 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=89 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:43:39.477020 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a1bbe-5b16-4dae-87d4-fe9547639a74 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:43:39.480457 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c26cb8-b678-4ab2-9917-7ab5fbe71fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:43:39.481082 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c26cb8-b678-4ab2-9917-7ab5fbe71fec service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:39.481360 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c26cb8-b678-4ab2-9917-7ab5fbe71fec service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:39.481629 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c26cb8-b678-4ab2-9917-7ab5fbe71fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:39.490780 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c26cb8-b678-4ab2-9917-7ab5fbe71fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:43:39.492186 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c26cb8-b678-4ab2-9917-7ab5fbe71fec service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:43:39.502194 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 578/1153] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:43:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:43:41.659694 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9ce8-0e04-4581-988a-dc6b6b6a9ab2 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:41.660156 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9ce8-0e04-4581-988a-dc6b6b6a9ab2 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:41.660270 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9ce8-0e04-4581-988a-dc6b6b6a9ab2 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:41.661584 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 576/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:43:41.666833 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d9d38-09a0-4764-8d35-e2cf72c3daf6 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:41.667274 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d9d38-09a0-4764-8d35-e2cf72c3daf6 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:41.667384 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d9d38-09a0-4764-8d35-e2cf72c3daf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:41.687484 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-cc3d9d38-09a0-4764-8d35-e2cf72c3daf6 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:43:41.688591 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-cc3d9d38-09a0-4764-8d35-e2cf72c3daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:41.700304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 579/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:43:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:43:42.035634 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b9ce8-0e04-4581-988a-dc6b6b6a9ab2 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:43:42.046783 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b9ce8-0e04-4581-988a-dc6b6b6a9ab2 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:43:42.050158 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e9504-e61e-4bfc-bc7f-a474759a8a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:43:42.050737 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e9504-e61e-4bfc-bc7f-a474759a8a64 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:42.051010 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e9504-e61e-4bfc-bc7f-a474759a8a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:42.051274 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e9504-e61e-4bfc-bc7f-a474759a8a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:42.059692 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e9504-e61e-4bfc-bc7f-a474759a8a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:43:42.061718 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e9504-e61e-4bfc-bc7f-a474759a8a64 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:43:42.070981 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 577/1156] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:43:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:43:45.981825 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a416f5-0abb-4fa5-b4a6-ac922c127787 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:45.982418 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a416f5-0abb-4fa5-b4a6-ac922c127787 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:45.982418 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a416f5-0abb-4fa5-b4a6-ac922c127787 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:45.983719 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 580/1157] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:43:45.988747 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e58e6-c547-418d-a36f-e0c607ece216 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:45.989214 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e58e6-c547-418d-a36f-e0c607ece216 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:45.989325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e58e6-c547-418d-a36f-e0c607ece216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:46.008291 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-296e58e6-c547-418d-a36f-e0c607ece216 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:43:46.009571 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-296e58e6-c547-418d-a36f-e0c607ece216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:46.017703 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 578/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:43:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:43:46.596880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a416f5-0abb-4fa5-b4a6-ac922c127787 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:43:46.598538 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-85a416f5-0abb-4fa5-b4a6-ac922c127787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:46.656907 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a416f5-0abb-4fa5-b4a6-ac922c127787 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:43:46.660439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32579111-6f4a-49b7-b180-cdd8c37edfeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d818956e1048a096830ec372382e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:43:46.661067 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32579111-6f4a-49b7-b180-cdd8c37edfeb service cinder] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:46.661349 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32579111-6f4a-49b7-b180-cdd8c37edfeb service cinder] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:46.661624 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32579111-6f4a-49b7-b180-cdd8c37edfeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:46.670404 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32579111-6f4a-49b7-b180-cdd8c37edfeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:43:46.671829 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32579111-6f4a-49b7-b180-cdd8c37edfeb service cinder] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:43:46.681259 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 581/1159] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:43:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:43:48.850670 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee0dec-0a3e-41d3-842e-c639971566eb None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:48.851234 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee0dec-0a3e-41d3-842e-c639971566eb None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:48.851234 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee0dec-0a3e-41d3-842e-c639971566eb None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:48.852504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 579/1160] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:43:48.857598 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9b1a-dd91-44a3-aaf0-00ddd7390d30 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:48.858528 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9b1a-dd91-44a3-aaf0-00ddd7390d30 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:48.858661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9b1a-dd91-44a3-aaf0-00ddd7390d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:48.878235 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-61fe9b1a-dd91-44a3-aaf0-00ddd7390d30 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:43:48.879404 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-61fe9b1a-dd91-44a3-aaf0-00ddd7390d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:48.886984 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 582/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:43:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:43:49.450479 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee0dec-0a3e-41d3-842e-c639971566eb None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:43:49.452673 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-7dee0dec-0a3e-41d3-842e-c639971566eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:43:49.460115 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=37 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:43:49.465814 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee0dec-0a3e-41d3-842e-c639971566eb None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:43:49.470001 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d962a5-0f6e-49fd-b63f-dc902feb6d78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0d818956e1048a096830ec372382e7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:43:49.474253 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d962a5-0f6e-49fd-b63f-dc902feb6d78 service cinder] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:43:49.474253 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d962a5-0f6e-49fd-b63f-dc902feb6d78 service cinder] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:43:49.474253 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d962a5-0f6e-49fd-b63f-dc902feb6d78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:43:49.479881 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d962a5-0f6e-49fd-b63f-dc902feb6d78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:43:49.481330 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d962a5-0f6e-49fd-b63f-dc902feb6d78 service cinder] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:43:49.490613 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 580/1162] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:43:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:43:58.872308 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=57 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:43:59.491681 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=5 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:45:04.881087 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91541a1f-475d-4fcf-abf0-d849ba9e77f4 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:04.882299 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91541a1f-475d-4fcf-abf0-d849ba9e77f4 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:04.882299 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91541a1f-475d-4fcf-abf0-d849ba9e77f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:04.895549 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcea67-9f68-4a39-aced-6924c2e3da8b None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:04.896089 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcea67-9f68-4a39-aced-6924c2e3da8b None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:04.896089 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcea67-9f68-4a39-aced-6924c2e3da8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:04.901188 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-91541a1f-475d-4fcf-abf0-d849ba9e77f4 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:04.902365 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-91541a1f-475d-4fcf-abf0-d849ba9e77f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:04.909963 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 583/1163] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:45:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:45:04.915219 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-a4fcea67-9f68-4a39-aced-6924c2e3da8b None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:04.916398 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-a4fcea67-9f68-4a39-aced-6924c2e3da8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:04.918096 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674feb6-023e-4058-928e-0f4c0d52c860 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:04.918381 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674feb6-023e-4058-928e-0f4c0d52c860 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:04.918654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674feb6-023e-4058-928e-0f4c0d52c860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:04.924290 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 581/1164] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:45:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:45:04.932776 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a9355-3afa-44aa-842b-6c63162f9931 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:04.933067 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a9355-3afa-44aa-842b-6c63162f9931 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:04.933342 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a9355-3afa-44aa-842b-6c63162f9931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:04.938303 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-5674feb6-023e-4058-928e-0f4c0d52c860 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:04.939727 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-5674feb6-023e-4058-928e-0f4c0d52c860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:04.948006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 584/1165] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:45:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:45:04.952490 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674feb6-023e-4058-928e-0f4c0d52c860 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:04.952632 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-190a9355-3afa-44aa-842b-6c63162f9931 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:04.953802 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-190a9355-3afa-44aa-842b-6c63162f9931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:04.961622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674feb6-023e-4058-928e-0f4c0d52c860 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:04.961748 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 582/1166] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:45:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:45:04.966104 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a9355-3afa-44aa-842b-6c63162f9931 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:04.966252 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05a6b3-cad1-41fb-8412-6be99d84f50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:04.966716 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05a6b3-cad1-41fb-8412-6be99d84f50d admin admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:04.966995 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05a6b3-cad1-41fb-8412-6be99d84f50d admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:04.967265 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05a6b3-cad1-41fb-8412-6be99d84f50d admin admin] PATH_INFO: `/v3/domains` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:04.967898 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05a6b3-cad1-41fb-8412-6be99d84f50d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:45:04.968199 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05a6b3-cad1-41fb-8412-6be99d84f50d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:04.969805 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05a6b3-cad1-41fb-8412-6be99d84f50d admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:04.974825 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a9355-3afa-44aa-842b-6c63162f9931 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:04.979914 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ff638-cd0f-4a12-9617-beb3b8ae5d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:04.980650 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ff638-cd0f-4a12-9617-beb3b8ae5d90 admin admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:04.980965 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ff638-cd0f-4a12-9617-beb3b8ae5d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:04.981237 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ff638-cd0f-4a12-9617-beb3b8ae5d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:04.981900 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ff638-cd0f-4a12-9617-beb3b8ae5d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88636) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:45:04.982304 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ff638-cd0f-4a12-9617-beb3b8ae5d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:04.982451 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 585/1167] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 19 17:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:45:04.983200 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: WARNING py.warnings [None req-e44ff638-cd0f-4a12-9617-beb3b8ae5d90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:45:04.983200 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: warnings.warn(msg) Aug 19 17:45:04.983200 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: Aug 19 17:45:04.984076 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ff638-cd0f-4a12-9617-beb3b8ae5d90 admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:04.989724 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05a6b3-cad1-41fb-8412-6be99d84f50d admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:04.996597 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 583/1168] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 19 17:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:45:05.000000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05a6b3-cad1-41fb-8412-6be99d84f50d admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:05.003638 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ff638-cd0f-4a12-9617-beb3b8ae5d90 admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:05.004587 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7f1e1-bbc2-48fe-94e5-f8d8e7b17e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:05.005215 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f1e1-bbc2-48fe-94e5-f8d8e7b17e39 admin admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.005497 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f1e1-bbc2-48fe-94e5-f8d8e7b17e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.005772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f1e1-bbc2-48fe-94e5-f8d8e7b17e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.006972 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7f1e1-bbc2-48fe-94e5-f8d8e7b17e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:05.008031 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: WARNING py.warnings [None req-0cb7f1e1-bbc2-48fe-94e5-f8d8e7b17e39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:45:05.008031 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: warnings.warn(msg) Aug 19 17:45:05.008031 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: Aug 19 17:45:05.009210 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7f1e1-bbc2-48fe-94e5-f8d8e7b17e39 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:05.013907 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ff638-cd0f-4a12-9617-beb3b8ae5d90 admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:05.019688 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399382ff-3683-4af1-9b7c-f18cc4272b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:05.020271 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399382ff-3683-4af1-9b7c-f18cc4272b2e admin admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.020990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399382ff-3683-4af1-9b7c-f18cc4272b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.021273 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399382ff-3683-4af1-9b7c-f18cc4272b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.021890 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399382ff-3683-4af1-9b7c-f18cc4272b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:05.023777 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399382ff-3683-4af1-9b7c-f18cc4272b2e admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:05.142920 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 586/1169] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 19 17:45:04 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:45:05.146959 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7f1e1-bbc2-48fe-94e5-f8d8e7b17e39 admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:05.165946 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 584/1170] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 19 17:45:05 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:45:05.170999 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399382ff-3683-4af1-9b7c-f18cc4272b2e admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:05.211782 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7f1e1-bbc2-48fe-94e5-f8d8e7b17e39 admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:05.232504 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399382ff-3683-4af1-9b7c-f18cc4272b2e admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:05.237169 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c06af6-d8d8-4a32-b76c-d93e2170a786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:05.237765 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c06af6-d8d8-4a32-b76c-d93e2170a786 admin admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.238046 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c06af6-d8d8-4a32-b76c-d93e2170a786 admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.238321 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c06af6-d8d8-4a32-b76c-d93e2170a786 admin admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.238941 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c06af6-d8d8-4a32-b76c-d93e2170a786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:05.240010 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: WARNING py.warnings [None req-94c06af6-d8d8-4a32-b76c-d93e2170a786 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:45:05.240010 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: warnings.warn(msg) Aug 19 17:45:05.240010 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: Aug 19 17:45:05.241847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c06af6-d8d8-4a32-b76c-d93e2170a786 admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:05.269108 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c7795-80e9-4406-8027-fd8293ed7c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:05.269716 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c7795-80e9-4406-8027-fd8293ed7c84 admin admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.269995 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c7795-80e9-4406-8027-fd8293ed7c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.270270 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c7795-80e9-4406-8027-fd8293ed7c84 admin admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.270883 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c7795-80e9-4406-8027-fd8293ed7c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:05.272919 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c7795-80e9-4406-8027-fd8293ed7c84 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:05.341600 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 585/1171] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 19 17:45:05 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:45:05.345571 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c06af6-d8d8-4a32-b76c-d93e2170a786 admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:05.355553 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c06af6-d8d8-4a32-b76c-d93e2170a786 admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:05.360204 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87eb51-eab4-48e2-81a1-961ce0997580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:05.360792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87eb51-eab4-48e2-81a1-961ce0997580 admin admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.361074 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87eb51-eab4-48e2-81a1-961ce0997580 admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.361339 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87eb51-eab4-48e2-81a1-961ce0997580 admin admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.361963 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87eb51-eab4-48e2-81a1-961ce0997580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:05.363626 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87eb51-eab4-48e2-81a1-961ce0997580 admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:05.367614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 587/1172] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 19 17:45:05 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:45:05.371753 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c7795-80e9-4406-8027-fd8293ed7c84 admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:05.377231 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 586/1173] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 19 17:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 17:45:05.378326 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87eb51-eab4-48e2-81a1-961ce0997580 admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:05.381815 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c7795-80e9-4406-8027-fd8293ed7c84 admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:05.386567 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe08c7-17bb-465c-948f-b9aeecc89676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:05.387142 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe08c7-17bb-465c-948f-b9aeecc89676 admin admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.387417 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe08c7-17bb-465c-948f-b9aeecc89676 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.387687 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe08c7-17bb-465c-948f-b9aeecc89676 admin admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.388055 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87eb51-eab4-48e2-81a1-961ce0997580 admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:05.388311 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe08c7-17bb-465c-948f-b9aeecc89676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:05.389932 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe08c7-17bb-465c-948f-b9aeecc89676 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:05.392810 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf218ed-c53b-40d2-b536-41ea80a82e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:05.393461 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf218ed-c53b-40d2-b536-41ea80a82e7a admin admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.393691 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf218ed-c53b-40d2-b536-41ea80a82e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.393960 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf218ed-c53b-40d2-b536-41ea80a82e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.394612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf218ed-c53b-40d2-b536-41ea80a82e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:05.396179 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf218ed-c53b-40d2-b536-41ea80a82e7a admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:05.400734 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 588/1174] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 19 17:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 17:45:05.404663 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe08c7-17bb-465c-948f-b9aeecc89676 admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:05.410248 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 587/1175] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 19 17:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:45:05.411162 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf218ed-c53b-40d2-b536-41ea80a82e7a admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:05.415481 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe08c7-17bb-465c-948f-b9aeecc89676 admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:05.420470 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b1981-aef3-454a-89d5-5061021b0cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:05.421322 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b1981-aef3-454a-89d5-5061021b0cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.421618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf218ed-c53b-40d2-b536-41ea80a82e7a admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:05.421939 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b1981-aef3-454a-89d5-5061021b0cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.422363 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b1981-aef3-454a-89d5-5061021b0cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.422993 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b1981-aef3-454a-89d5-5061021b0cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:05.424708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b1981-aef3-454a-89d5-5061021b0cd7 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:05.426307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1b28e-4dab-413f-904d-d94e9ab363ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:05.426948 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1b28e-4dab-413f-904d-d94e9ab363ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.427225 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1b28e-4dab-413f-904d-d94e9ab363ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.427498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1b28e-4dab-413f-904d-d94e9ab363ea admin admin] PATH_INFO: `/v3/projects/8350c4b8d3034e90bf43db1ce58fe2c4/users/54209c27ba714b90859f06041f59671d/roles/f81ebe87e8a74c24a390dbaafdacdbce` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.435604 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 589/1176] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 19 17:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 17:45:05.439879 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b1981-aef3-454a-89d5-5061021b0cd7 admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:05.442779 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1b28e-4dab-413f-904d-d94e9ab363ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8350c4b8d3034e90bf43db1ce58fe2c4, user_id=54209c27ba714b90859f06041f59671d, role_id=f81ebe87e8a74c24a390dbaafdacdbce)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:05.445719 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1b28e-4dab-413f-904d-d94e9ab363ea admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:05.449369 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b1981-aef3-454a-89d5-5061021b0cd7 admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:05.453852 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c0e98-599b-4dcc-ba60-5f5352a34305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:05.454472 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c0e98-599b-4dcc-ba60-5f5352a34305 admin admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.465566 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c0e98-599b-4dcc-ba60-5f5352a34305 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.465566 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c0e98-599b-4dcc-ba60-5f5352a34305 admin admin] PATH_INFO: `/v3/projects/458cb47c34de48b092e860046d5d137a/users/479c5ef172934abeafbb65a531083c0f/roles/f81ebe87e8a74c24a390dbaafdacdbce` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.469273 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c0e98-599b-4dcc-ba60-5f5352a34305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=458cb47c34de48b092e860046d5d137a, user_id=479c5ef172934abeafbb65a531083c0f, role_id=f81ebe87e8a74c24a390dbaafdacdbce)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:05.470273 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: WARNING py.warnings [None req-785c0e98-599b-4dcc-ba60-5f5352a34305 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 17:45:05.470273 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: warnings.warn(msg) Aug 19 17:45:05.470273 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: Aug 19 17:45:05.472185 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c0e98-599b-4dcc-ba60-5f5352a34305 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:05.514610 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 588/1177] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 19 17:45:05 2022] PUT /identity/v3/projects/8350c4b8d3034e90bf43db1ce58fe2c4/users/54209c27ba714b90859f06041f59671d/roles/f81ebe87e8a74c24a390dbaafdacdbce => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:45:05.519423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86f587-0393-4032-ae12-a3ad046d297b None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.519705 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86f587-0393-4032-ae12-a3ad046d297b None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.519980 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86f587-0393-4032-ae12-a3ad046d297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.538712 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-0e86f587-0393-4032-ae12-a3ad046d297b None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:05.540017 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-0e86f587-0393-4032-ae12-a3ad046d297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:05.547164 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 590/1178] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 19 17:45:05 2022] PUT /identity/v3/projects/458cb47c34de48b092e860046d5d137a/users/479c5ef172934abeafbb65a531083c0f/roles/f81ebe87e8a74c24a390dbaafdacdbce => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 17:45:05.554163 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056e915-5480-40b1-849d-87e520d19893 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.554640 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056e915-5480-40b1-849d-87e520d19893 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.554992 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056e915-5480-40b1-849d-87e520d19893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.562502 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:45:05.574547 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-b056e915-5480-40b1-849d-87e520d19893 None None] MFA Rules not processed for user `4194ee18e96548d99ebb8f12d43b6b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:05.575702 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-b056e915-5480-40b1-849d-87e520d19893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:05.592238 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:45:05.604101 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 589/1179] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:45:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:45:05.614151 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86f587-0393-4032-ae12-a3ad046d297b None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:05.637209 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 591/1180] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:45:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:45:05.647814 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056e915-5480-40b1-849d-87e520d19893 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:05.669313 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86f587-0393-4032-ae12-a3ad046d297b None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:05.672940 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba274071-dbd7-450f-83cd-d4cc0834231b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:05.673547 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba274071-dbd7-450f-83cd-d4cc0834231b service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.673823 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba274071-dbd7-450f-83cd-d4cc0834231b service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.674092 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba274071-dbd7-450f-83cd-d4cc0834231b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.683512 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba274071-dbd7-450f-83cd-d4cc0834231b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:05.685125 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba274071-dbd7-450f-83cd-d4cc0834231b service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:05.695086 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 590/1181] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:45:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 17:45:05.700707 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056e915-5480-40b1-849d-87e520d19893 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:05.704690 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105efeab-2707-4738-a885-06049569a93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:05.708119 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105efeab-2707-4738-a885-06049569a93a service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:05.708119 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105efeab-2707-4738-a885-06049569a93a service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:05.708119 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105efeab-2707-4738-a885-06049569a93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:05.716075 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105efeab-2707-4738-a885-06049569a93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:05.717516 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105efeab-2707-4738-a885-06049569a93a service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:05.727445 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 592/1182] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:45:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 17:45:12.684714 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cd953-56e8-4fa0-bb50-028c0d8c28f2 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:12.686857 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cd953-56e8-4fa0-bb50-028c0d8c28f2 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:12.686857 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cd953-56e8-4fa0-bb50-028c0d8c28f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:12.713441 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-868cd953-56e8-4fa0-bb50-028c0d8c28f2 None None] MFA Rules not processed for user `54209c27ba714b90859f06041f59671d`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:12.714668 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-868cd953-56e8-4fa0-bb50-028c0d8c28f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:12.785635 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 591/1183] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:45:12 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:45:12.786784 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105efeab-2707-4738-a885-06049569a93a service neutron] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:12.798470 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105efeab-2707-4738-a885-06049569a93a service neutron] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:12.803085 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a5be2-2ac7-4b90-86cc-1e063285a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:12.803749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a5be2-2ac7-4b90-86cc-1e063285a434 admin admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:12.804098 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a5be2-2ac7-4b90-86cc-1e063285a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:12.804439 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a5be2-2ac7-4b90-86cc-1e063285a434 admin admin] PATH_INFO: `/v3/projects` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:12.805516 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a5be2-2ac7-4b90-86cc-1e063285a434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:12.807635 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a5be2-2ac7-4b90-86cc-1e063285a434 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:12.919272 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 593/1184] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 19 17:45:12 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:45:12.923206 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cd953-56e8-4fa0-bb50-028c0d8c28f2 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:12.939508 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cd953-56e8-4fa0-bb50-028c0d8c28f2 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:13.042910 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f1a58-41d5-4c9c-b7ea-59bc29ba89af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:13.043536 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f1a58-41d5-4c9c-b7ea-59bc29ba89af admin admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:13.043818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f1a58-41d5-4c9c-b7ea-59bc29ba89af admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:13.044093 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f1a58-41d5-4c9c-b7ea-59bc29ba89af admin admin] PATH_INFO: `/v3/users` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:13.044756 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f1a58-41d5-4c9c-b7ea-59bc29ba89af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:13.052754 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f1a58-41d5-4c9c-b7ea-59bc29ba89af admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:13.141776 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 592/1185] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 19 17:45:12 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:45:13.145706 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a5be2-2ac7-4b90-86cc-1e063285a434 admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:13.157420 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a5be2-2ac7-4b90-86cc-1e063285a434 admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:13.162965 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ca57b-7f5e-438c-893e-8a7b84a6d5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:13.163704 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ca57b-7f5e-438c-893e-8a7b84a6d5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:13.164110 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ca57b-7f5e-438c-893e-8a7b84a6d5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:13.164480 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ca57b-7f5e-438c-893e-8a7b84a6d5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:13.165270 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ca57b-7f5e-438c-893e-8a7b84a6d5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:13.166989 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ca57b-7f5e-438c-893e-8a7b84a6d5f3 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:13.203364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 594/1186] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 19 17:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:45:13.204573 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f1a58-41d5-4c9c-b7ea-59bc29ba89af admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:13.216032 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f1a58-41d5-4c9c-b7ea-59bc29ba89af admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:13.242631 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814196e-eba2-4289-9bd5-b7db78c92ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:13.243312 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814196e-eba2-4289-9bd5-b7db78c92ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:13.243600 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814196e-eba2-4289-9bd5-b7db78c92ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:13.243871 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814196e-eba2-4289-9bd5-b7db78c92ec8 admin admin] PATH_INFO: `/v3/projects/f6ad0faafeb24686a0a577735ad07eaa/users/c7f74cc4f980400a977feaf5ee2ff6e4/roles/17791940429e48ac98d4bd49aa53a88c` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:13.268358 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814196e-eba2-4289-9bd5-b7db78c92ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad0faafeb24686a0a577735ad07eaa, user_id=c7f74cc4f980400a977feaf5ee2ff6e4, role_id=17791940429e48ac98d4bd49aa53a88c)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:13.274612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814196e-eba2-4289-9bd5-b7db78c92ec8 admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:13.277665 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:45:13.392569 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 593/1187] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 19 17:45:13 2022] PUT /identity/v3/projects/f6ad0faafeb24686a0a577735ad07eaa/users/c7f74cc4f980400a977feaf5ee2ff6e4/roles/17791940429e48ac98d4bd49aa53a88c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 17:45:13.393689 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ca57b-7f5e-438c-893e-8a7b84a6d5f3 admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:13.408375 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ca57b-7f5e-438c-893e-8a7b84a6d5f3 admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:13.519794 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cfefb-2996-4c87-b442-f764042d57a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:13.520494 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cfefb-2996-4c87-b442-f764042d57a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:13.520809 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cfefb-2996-4c87-b442-f764042d57a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:13.521090 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cfefb-2996-4c87-b442-f764042d57a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:13.522298 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cfefb-2996-4c87-b442-f764042d57a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:13.524063 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cfefb-2996-4c87-b442-f764042d57a5 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:13.538894 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 595/1188] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 19 17:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 17:45:13.543990 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814196e-eba2-4289-9bd5-b7db78c92ec8 admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:13.555235 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814196e-eba2-4289-9bd5-b7db78c92ec8 admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:13.567704 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8c3de-8281-45f1-a5c4-7d426c85c46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:13.569028 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8c3de-8281-45f1-a5c4-7d426c85c46a admin admin] REQUEST_METHOD: `PUT` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:13.569325 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8c3de-8281-45f1-a5c4-7d426c85c46a admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:13.569597 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8c3de-8281-45f1-a5c4-7d426c85c46a admin admin] PATH_INFO: `/v3/projects/f6ad0faafeb24686a0a577735ad07eaa/users/c7f74cc4f980400a977feaf5ee2ff6e4/roles/17791940429e48ac98d4bd49aa53a88c` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:13.573612 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8c3de-8281-45f1-a5c4-7d426c85c46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad0faafeb24686a0a577735ad07eaa, user_id=c7f74cc4f980400a977feaf5ee2ff6e4, role_id=17791940429e48ac98d4bd49aa53a88c)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:13.577901 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8c3de-8281-45f1-a5c4-7d426c85c46a admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:13.598565 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 594/1189] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 19 17:45:13 2022] PUT /identity/v3/projects/f6ad0faafeb24686a0a577735ad07eaa/users/c7f74cc4f980400a977feaf5ee2ff6e4/roles/17791940429e48ac98d4bd49aa53a88c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:45:14.412521 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54bbd8-4fa6-4092-a126-56e14624dd41 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:14.413091 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54bbd8-4fa6-4092-a126-56e14624dd41 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:14.413091 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54bbd8-4fa6-4092-a126-56e14624dd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:14.434504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:45:14.445026 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-1d54bbd8-4fa6-4092-a126-56e14624dd41 None None] MFA Rules not processed for user `479c5ef172934abeafbb65a531083c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:14.446669 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-1d54bbd8-4fa6-4092-a126-56e14624dd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:14.524578 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 596/1190] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:45:14 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:45:14.529267 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8c3de-8281-45f1-a5c4-7d426c85c46a admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:14.612867 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8c3de-8281-45f1-a5c4-7d426c85c46a admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:14.618532 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e46db5-ffa8-47c4-8f1b-3a9863787098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:14.619163 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e46db5-ffa8-47c4-8f1b-3a9863787098 admin admin] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:14.619468 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e46db5-ffa8-47c4-8f1b-3a9863787098 admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:14.619773 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e46db5-ffa8-47c4-8f1b-3a9863787098 admin admin] PATH_INFO: `/v3/projects` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:14.620375 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e46db5-ffa8-47c4-8f1b-3a9863787098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:14.622370 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e46db5-ffa8-47c4-8f1b-3a9863787098 admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:14.717009 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 595/1191] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 19 17:45:14 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:45:14.720047 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54bbd8-4fa6-4092-a126-56e14624dd41 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:14.732001 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54bbd8-4fa6-4092-a126-56e14624dd41 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:14.802800 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbcc16-8eec-4edc-9329-f2b1df9fb9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:14.803990 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbcc16-8eec-4edc-9329-f2b1df9fb9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:14.804263 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbcc16-8eec-4edc-9329-f2b1df9fb9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:14.804527 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbcc16-8eec-4edc-9329-f2b1df9fb9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:14.805226 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbcc16-8eec-4edc-9329-f2b1df9fb9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:14.807072 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbcc16-8eec-4edc-9329-f2b1df9fb9a6 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:14.930833 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 597/1192] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 19 17:45:14 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:45:14.934976 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e46db5-ffa8-47c4-8f1b-3a9863787098 admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:14.950446 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e46db5-ffa8-47c4-8f1b-3a9863787098 admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:14.960389 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31928584-d8bd-4cee-8226-674bcd0d19ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:14.961537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31928584-d8bd-4cee-8226-674bcd0d19ae admin admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:14.961537 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31928584-d8bd-4cee-8226-674bcd0d19ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:14.961916 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31928584-d8bd-4cee-8226-674bcd0d19ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:14.962676 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31928584-d8bd-4cee-8226-674bcd0d19ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:14.964420 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31928584-d8bd-4cee-8226-674bcd0d19ae admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:14.979064 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 596/1193] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 19 17:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:45:14.988967 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbcc16-8eec-4edc-9329-f2b1df9fb9a6 admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:15.002010 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbcc16-8eec-4edc-9329-f2b1df9fb9a6 admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:15.007502 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6009-b23f-41f2-a0d3-c7b9abcbb915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:15.008180 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6009-b23f-41f2-a0d3-c7b9abcbb915 admin admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:15.008468 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6009-b23f-41f2-a0d3-c7b9abcbb915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:15.008749 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6009-b23f-41f2-a0d3-c7b9abcbb915 admin admin] PATH_INFO: `/v3/projects/404ba60dcf494d73a4e46f4fc6948d37/users/581e4df3cb474faeb12aee5a718690de/roles/17791940429e48ac98d4bd49aa53a88c` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:15.028622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a6009-b23f-41f2-a0d3-c7b9abcbb915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404ba60dcf494d73a4e46f4fc6948d37, user_id=581e4df3cb474faeb12aee5a718690de, role_id=17791940429e48ac98d4bd49aa53a88c)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:15.033319 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a6009-b23f-41f2-a0d3-c7b9abcbb915 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:15.110775 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 598/1194] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 19 17:45:14 2022] PUT /identity/v3/projects/404ba60dcf494d73a4e46f4fc6948d37/users/581e4df3cb474faeb12aee5a718690de/roles/17791940429e48ac98d4bd49aa53a88c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:45:15.114880 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31928584-d8bd-4cee-8226-674bcd0d19ae admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:15.145763 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31928584-d8bd-4cee-8226-674bcd0d19ae admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:15.231093 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53468187-b020-4006-84f3-bf01f4cbbf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:15.231925 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53468187-b020-4006-84f3-bf01f4cbbf03 admin admin] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:15.232208 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53468187-b020-4006-84f3-bf01f4cbbf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:15.232479 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53468187-b020-4006-84f3-bf01f4cbbf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:15.233983 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53468187-b020-4006-84f3-bf01f4cbbf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:15.237310 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53468187-b020-4006-84f3-bf01f4cbbf03 admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:15.260306 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6009-b23f-41f2-a0d3-c7b9abcbb915 admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:15.260999 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 597/1195] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 19 17:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:45:15.277692 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6009-b23f-41f2-a0d3-c7b9abcbb915 admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:15.295224 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee72a45-e95a-454d-9574-7f6a73d42751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:15.295958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee72a45-e95a-454d-9574-7f6a73d42751 admin admin] REQUEST_METHOD: `PUT` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:15.296169 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee72a45-e95a-454d-9574-7f6a73d42751 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:15.296483 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee72a45-e95a-454d-9574-7f6a73d42751 admin admin] PATH_INFO: `/v3/projects/404ba60dcf494d73a4e46f4fc6948d37/users/581e4df3cb474faeb12aee5a718690de/roles/17791940429e48ac98d4bd49aa53a88c` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:15.301443 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee72a45-e95a-454d-9574-7f6a73d42751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404ba60dcf494d73a4e46f4fc6948d37, user_id=581e4df3cb474faeb12aee5a718690de, role_id=17791940429e48ac98d4bd49aa53a88c)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:15.305706 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee72a45-e95a-454d-9574-7f6a73d42751 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:15.325304 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 599/1196] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 19 17:45:15 2022] PUT /identity/v3/projects/404ba60dcf494d73a4e46f4fc6948d37/users/581e4df3cb474faeb12aee5a718690de/roles/17791940429e48ac98d4bd49aa53a88c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 17:45:20.576235 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285718da-5ba3-4bfa-a0f3-dd30fec4f02f None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:20.576885 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285718da-5ba3-4bfa-a0f3-dd30fec4f02f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:20.576885 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285718da-5ba3-4bfa-a0f3-dd30fec4f02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:20.611963 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-285718da-5ba3-4bfa-a0f3-dd30fec4f02f None None] MFA Rules not processed for user `c7f74cc4f980400a977feaf5ee2ff6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:20.613153 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-285718da-5ba3-4bfa-a0f3-dd30fec4f02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:20.673781 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:45:20.721100 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 598/1197] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:45:20 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:45:20.735075 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee72a45-e95a-454d-9574-7f6a73d42751 admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:20.737083 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-2ee72a45-e95a-454d-9574-7f6a73d42751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:20.808958 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee72a45-e95a-454d-9574-7f6a73d42751 admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:20.818068 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7493e-f783-4b5a-8ea9-5a5fa444aa80 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe5b4476e8e413f8d409c8e73c4c4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:20.819620 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7493e-f783-4b5a-8ea9-5a5fa444aa80 service glance] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:20.820071 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7493e-f783-4b5a-8ea9-5a5fa444aa80 service glance] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:20.820491 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7493e-f783-4b5a-8ea9-5a5fa444aa80 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:20.828644 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:45:20.888691 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7493e-f783-4b5a-8ea9-5a5fa444aa80 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:20.890260 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7493e-f783-4b5a-8ea9-5a5fa444aa80 service glance] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:20.901808 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 600/1198] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:45:20 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:45:22.362359 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0b8d0-fb76-4cde-a742-697131ab977f None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:22.364023 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0b8d0-fb76-4cde-a742-697131ab977f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:22.364595 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0b8d0-fb76-4cde-a742-697131ab977f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:22.413252 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-52d0b8d0-fb76-4cde-a742-697131ab977f None None] MFA Rules not processed for user `581e4df3cb474faeb12aee5a718690de`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:22.414625 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-52d0b8d0-fb76-4cde-a742-697131ab977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:22.514188 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 599/1199] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:45:22 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:45:22.527366 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7493e-f783-4b5a-8ea9-5a5fa444aa80 service glance] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:22.536770 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7493e-f783-4b5a-8ea9-5a5fa444aa80 service glance] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:22.543900 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ca32b-ca85-404a-99d0-45fbc42cfdc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe5b4476e8e413f8d409c8e73c4c4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:22.544626 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ca32b-ca85-404a-99d0-45fbc42cfdc7 service glance] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:22.544943 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ca32b-ca85-404a-99d0-45fbc42cfdc7 service glance] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:22.545213 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ca32b-ca85-404a-99d0-45fbc42cfdc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:22.623954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ca32b-ca85-404a-99d0-45fbc42cfdc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:22.625553 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ca32b-ca85-404a-99d0-45fbc42cfdc7 service glance] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:22.638700 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 601/1200] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:45:22 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:45:30.743666 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fe2b8-beb3-4a4a-8b2b-bd614a161f2f None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:30.744313 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fe2b8-beb3-4a4a-8b2b-bd614a161f2f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:30.744313 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fe2b8-beb3-4a4a-8b2b-bd614a161f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:30.769007 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-301fe2b8-beb3-4a4a-8b2b-bd614a161f2f None None] MFA Rules not processed for user `54209c27ba714b90859f06041f59671d`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:30.770247 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-301fe2b8-beb3-4a4a-8b2b-bd614a161f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:30.779849 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 600/1201] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:45:30 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:45:31.081504 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6297-b049-4a97-a942-7c190f4e6a90 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:31.082013 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6297-b049-4a97-a942-7c190f4e6a90 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:31.082104 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6297-b049-4a97-a942-7c190f4e6a90 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:31.083429 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 602/1202] 10.222.0.27 () {54 vars in 962 bytes} [Fri Aug 19 17:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:45:31.089343 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920afff5-d9a9-44c2-881c-8872572f0ca6 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:31.090418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920afff5-d9a9-44c2-881c-8872572f0ca6 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:31.090708 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920afff5-d9a9-44c2-881c-8872572f0ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:31.119787 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-920afff5-d9a9-44c2-881c-8872572f0ca6 None None] MFA Rules not processed for user `fb1c954936f64051b09afba8df544ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:31.121119 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-920afff5-d9a9-44c2-881c-8872572f0ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:31.192831 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 601/1203] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Aug 19 17:45:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:45:31.200227 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd323-a6b1-4d04-bcfb-a86bf9c0f93c None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:31.200523 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd323-a6b1-4d04-bcfb-a86bf9c0f93c None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:31.200911 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd323-a6b1-4d04-bcfb-a86bf9c0f93c None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:31.202244 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 603/1204] 10.222.0.27 () {54 vars in 912 bytes} [Fri Aug 19 17:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:45:31.207843 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1234b-a21e-4e7e-9b79-31bb21243d5a None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:31.208136 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1234b-a21e-4e7e-9b79-31bb21243d5a None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:31.208412 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1234b-a21e-4e7e-9b79-31bb21243d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:31.229418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-4df1234b-a21e-4e7e-9b79-31bb21243d5a None None] MFA Rules not processed for user `fb1c954936f64051b09afba8df544ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:31.230654 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-4df1234b-a21e-4e7e-9b79-31bb21243d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:31.239070 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 602/1205] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 19 17:45:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:45:31.251004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcd323-a6b1-4d04-bcfb-a86bf9c0f93c None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:31.252647 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-b1bcd323-a6b1-4d04-bcfb-a86bf9c0f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:31.265595 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcd323-a6b1-4d04-bcfb-a86bf9c0f93c None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:31.269284 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe0be4-602f-4fb4-8abb-f07eb4794322 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbe5b4476e8e413f8d409c8e73c4c4f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:31.270328 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe0be4-602f-4fb4-8abb-f07eb4794322 service glance] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:31.270613 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe0be4-602f-4fb4-8abb-f07eb4794322 service glance] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:31.270887 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe0be4-602f-4fb4-8abb-f07eb4794322 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:31.281219 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe0be4-602f-4fb4-8abb-f07eb4794322 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:31.282802 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe0be4-602f-4fb4-8abb-f07eb4794322 service glance] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:31.294205 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 604/1206] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:45:31 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:45:31.640263 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c0824-cec9-463a-9b5d-1bb11b1f7b80 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:31.640538 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c0824-cec9-463a-9b5d-1bb11b1f7b80 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:31.640845 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c0824-cec9-463a-9b5d-1bb11b1f7b80 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:31.642330 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 603/1207] 10.222.0.27 () {54 vars in 912 bytes} [Fri Aug 19 17:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:45:31.648503 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47bdf0-8bb6-4a63-b070-55f3c1545c19 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:31.649018 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47bdf0-8bb6-4a63-b070-55f3c1545c19 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:31.649281 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47bdf0-8bb6-4a63-b070-55f3c1545c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:31.670981 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-6b47bdf0-8bb6-4a63-b070-55f3c1545c19 None None] MFA Rules not processed for user `f21c562918c04d18aa0b01a3bdd4d6af`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:31.670981 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-6b47bdf0-8bb6-4a63-b070-55f3c1545c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:31.726007 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 605/1208] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 19 17:45:31 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:45:31.737436 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c0824-cec9-463a-9b5d-1bb11b1f7b80 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:31.739074 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-b41c0824-cec9-463a-9b5d-1bb11b1f7b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:31.752182 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c0824-cec9-463a-9b5d-1bb11b1f7b80 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:31.755819 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdf56d-e96f-4443-b9ee-151148d9e624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:31.756410 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdf56d-e96f-4443-b9ee-151148d9e624 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:31.756694 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdf56d-e96f-4443-b9ee-151148d9e624 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:31.757042 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdf56d-e96f-4443-b9ee-151148d9e624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:31.764017 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdf56d-e96f-4443-b9ee-151148d9e624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:31.765542 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdf56d-e96f-4443-b9ee-151148d9e624 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:31.773737 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 604/1209] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:45:31 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 17:45:32.318400 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9706db-b174-4510-8758-328cd8fdea84 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:32.319484 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9706db-b174-4510-8758-328cd8fdea84 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:32.319627 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9706db-b174-4510-8758-328cd8fdea84 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:32.321342 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 606/1210] 10.222.0.27 () {54 vars in 962 bytes} [Fri Aug 19 17:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:45:32.327126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608483d-2931-4063-9c3e-c97f967ff81f None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:32.327409 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608483d-2931-4063-9c3e-c97f967ff81f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:32.327685 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608483d-2931-4063-9c3e-c97f967ff81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:32.349303 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3625c4-3719-4f01-96fe-08508e3ce64a None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:32.349506 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-6608483d-2931-4063-9c3e-c97f967ff81f None None] MFA Rules not processed for user `fb1c954936f64051b09afba8df544ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:32.349823 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3625c4-3719-4f01-96fe-08508e3ce64a None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:32.350279 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3625c4-3719-4f01-96fe-08508e3ce64a None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:32.350686 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-6608483d-2931-4063-9c3e-c97f967ff81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:32.352121 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 607/1211] 10.222.0.27 () {54 vars in 961 bytes} [Fri Aug 19 17:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:45:32.357723 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb664c2d-edeb-40ed-ad24-0d129df0d012 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:32.358014 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb664c2d-edeb-40ed-ad24-0d129df0d012 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:32.358611 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb664c2d-edeb-40ed-ad24-0d129df0d012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:32.361168 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 605/1212] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Aug 19 17:45:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:45:32.366859 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d1237-a272-42fc-b691-566bfd0590fe None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:32.367143 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d1237-a272-42fc-b691-566bfd0590fe None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:32.367423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d1237-a272-42fc-b691-566bfd0590fe None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:32.368998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 606/1213] 10.222.0.27 () {54 vars in 912 bytes} [Fri Aug 19 17:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:45:32.375130 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563d215-c446-4626-b949-755a6e4d2d71 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:32.375440 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563d215-c446-4626-b949-755a6e4d2d71 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:32.375794 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563d215-c446-4626-b949-755a6e4d2d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:32.382830 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-fb664c2d-edeb-40ed-ad24-0d129df0d012 None None] MFA Rules not processed for user `82313d212e4f454697849ea186208785`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:32.384035 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-fb664c2d-edeb-40ed-ad24-0d129df0d012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:32.399641 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-a563d215-c446-4626-b949-755a6e4d2d71 None None] MFA Rules not processed for user `fb1c954936f64051b09afba8df544ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:32.401326 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-a563d215-c446-4626-b949-755a6e4d2d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:32.421373 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 607/1214] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 19 17:45:32 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:45:32.428345 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563d215-c446-4626-b949-755a6e4d2d71 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:32.436150 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=100 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:45:32.437626 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563d215-c446-4626-b949-755a6e4d2d71 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:32.441542 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cebe8d-3bd1-4611-8a0c-8e1144f42956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:32.442129 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cebe8d-3bd1-4611-8a0c-8e1144f42956 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:32.442405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cebe8d-3bd1-4611-8a0c-8e1144f42956 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:32.442678 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cebe8d-3bd1-4611-8a0c-8e1144f42956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:32.454170 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cebe8d-3bd1-4611-8a0c-8e1144f42956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:32.455791 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cebe8d-3bd1-4611-8a0c-8e1144f42956 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:32.466498 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 608/1215] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:45:32 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 17:45:32.468494 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 608/1216] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Aug 19 17:45:32 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:45:32.475965 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cebe8d-3bd1-4611-8a0c-8e1144f42956 service neutron] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:32.482695 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=100 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:45:32.487307 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cebe8d-3bd1-4611-8a0c-8e1144f42956 service neutron] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:32.494633 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fee2d-e68f-403e-a9f9-75175e39136b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82313d212e4f454697849ea186208785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:32.494633 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fee2d-e68f-403e-a9f9-75175e39136b service placement] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:32.494633 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fee2d-e68f-403e-a9f9-75175e39136b service placement] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:32.494633 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fee2d-e68f-403e-a9f9-75175e39136b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:32.495928 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-1f2fee2d-e68f-403e-a9f9-75175e39136b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:32.508233 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fee2d-e68f-403e-a9f9-75175e39136b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:32.510539 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fee2d-e68f-403e-a9f9-75175e39136b service placement] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:32.521683 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 609/1217] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:45:32 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:45:42.469171 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=11 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:45:42.517379 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=4 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:45:45.664750 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f180bb-2830-443e-9799-0d6aea8c4ecf None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:45.665318 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f180bb-2830-443e-9799-0d6aea8c4ecf None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:45.665654 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f180bb-2830-443e-9799-0d6aea8c4ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:45.685710 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-a2f180bb-2830-443e-9799-0d6aea8c4ecf None None] MFA Rules not processed for user `f21c562918c04d18aa0b01a3bdd4d6af`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:45.686957 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-a2f180bb-2830-443e-9799-0d6aea8c4ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:45.693923 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 609/1218] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Aug 19 17:45:45 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:45:45.709151 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fee2d-e68f-403e-a9f9-75175e39136b service placement] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:45.719447 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fee2d-e68f-403e-a9f9-75175e39136b service placement] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:45.723024 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ad83c-8dad-4f19-a9f4-d1b144b41b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:45.723618 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ad83c-8dad-4f19-a9f4-d1b144b41b6d service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:45.723892 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ad83c-8dad-4f19-a9f4-d1b144b41b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:45.724159 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ad83c-8dad-4f19-a9f4-d1b144b41b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:45.731830 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ad83c-8dad-4f19-a9f4-d1b144b41b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:45.733300 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ad83c-8dad-4f19-a9f4-d1b144b41b6d service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:45.741642 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 610/1219] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:45:45 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:45:46.592276 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabde2e3-bab0-4940-be6b-f1509c100c5b None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:46.592794 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabde2e3-bab0-4940-be6b-f1509c100c5b None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:46.593074 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabde2e3-bab0-4940-be6b-f1509c100c5b None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:46.595142 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 610/1220] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 19 17:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:45:46.612954 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a69c8-3487-454b-a33a-384a24eff810 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:46.613517 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a69c8-3487-454b-a33a-384a24eff810 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:46.614243 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a69c8-3487-454b-a33a-384a24eff810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:46.643705 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-4a3a69c8-3487-454b-a33a-384a24eff810 None None] MFA Rules not processed for user `fb1c954936f64051b09afba8df544ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:46.645138 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-4a3a69c8-3487-454b-a33a-384a24eff810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:46.655495 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 611/1221] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 19 17:45:46 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:45:46.668681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabde2e3-bab0-4940-be6b-f1509c100c5b None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:46.683465 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabde2e3-bab0-4940-be6b-f1509c100c5b None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:46.689009 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805e4f1-27a3-4020-a4a0-958ad0b02845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:46.689337 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805e4f1-27a3-4020-a4a0-958ad0b02845 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:46.689725 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805e4f1-27a3-4020-a4a0-958ad0b02845 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:46.690258 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805e4f1-27a3-4020-a4a0-958ad0b02845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:46.707078 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805e4f1-27a3-4020-a4a0-958ad0b02845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:46.708766 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805e4f1-27a3-4020-a4a0-958ad0b02845 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:46.729940 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 611/1222] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:45:46 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:45:53.028844 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e755844-599d-41d9-b5d4-4aad2f500e6f None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:53.029458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e755844-599d-41d9-b5d4-4aad2f500e6f None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:53.029458 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e755844-599d-41d9-b5d4-4aad2f500e6f None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:53.030997 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 612/1223] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 19 17:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:45:53.041880 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7d0ee-519f-4387-a465-33818ae9eae7 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:53.042416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7d0ee-519f-4387-a465-33818ae9eae7 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:53.042520 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7d0ee-519f-4387-a465-33818ae9eae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:53.061536 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-bed7d0ee-519f-4387-a465-33818ae9eae7 None None] MFA Rules not processed for user `fb1c954936f64051b09afba8df544ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:45:53.062753 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-bed7d0ee-519f-4387-a465-33818ae9eae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:45:53.071789 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 612/1224] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 19 17:45:53 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:45:53.086246 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e755844-599d-41d9-b5d4-4aad2f500e6f None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:45:53.100025 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e755844-599d-41d9-b5d4-4aad2f500e6f None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:45:53.105160 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a299eb-7fcb-488c-ba71-ce443eda61e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:45:53.118764 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a299eb-7fcb-488c-ba71-ce443eda61e0 service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:45:53.118764 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a299eb-7fcb-488c-ba71-ce443eda61e0 service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:45:53.118764 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a299eb-7fcb-488c-ba71-ce443eda61e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:45:53.118764 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a299eb-7fcb-488c-ba71-ce443eda61e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:45:53.118764 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a299eb-7fcb-488c-ba71-ce443eda61e0 service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:45:53.125333 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 613/1225] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:45:53 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:46:03.056886 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=12 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:46:03.121387 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=15 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:46:12.590310 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7d0ee-519f-4387-a465-33818ae9eae7 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:46:12.599875 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7d0ee-519f-4387-a465-33818ae9eae7 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:46:12.604035 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f74904-84dd-4197-b729-ce70d54ed83a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:46:12.604662 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74904-84dd-4197-b729-ce70d54ed83a service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:46:12.604976 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74904-84dd-4197-b729-ce70d54ed83a service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:46:12.605246 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f74904-84dd-4197-b729-ce70d54ed83a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:46:12.615158 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f74904-84dd-4197-b729-ce70d54ed83a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:46:12.617280 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f74904-84dd-4197-b729-ce70d54ed83a service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:46:12.627726 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 613/1226] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:46:12 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:46:22.159542 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed4b83-dc46-4140-aeac-414c0fa8e66e None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:46:22.160080 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed4b83-dc46-4140-aeac-414c0fa8e66e None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:46:22.160173 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed4b83-dc46-4140-aeac-414c0fa8e66e None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:46:22.161735 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 614/1227] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 19 17:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:46:22.173249 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c35c-ad9f-4700-980f-793eb68cf6b7 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:46:22.173796 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c35c-ad9f-4700-980f-793eb68cf6b7 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:46:22.173796 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c35c-ad9f-4700-980f-793eb68cf6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:46:22.196201 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-6426c35c-ad9f-4700-980f-793eb68cf6b7 None None] MFA Rules not processed for user `fb1c954936f64051b09afba8df544ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:46:22.198198 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-6426c35c-ad9f-4700-980f-793eb68cf6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:46:22.207412 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 614/1228] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 19 17:46:22 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:46:22.230370 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed4b83-dc46-4140-aeac-414c0fa8e66e None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:46:22.245282 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed4b83-dc46-4140-aeac-414c0fa8e66e None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:46:22.251385 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5985b1d-38a6-4a13-aa9d-9c7abfc524c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:46:22.252036 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5985b1d-38a6-4a13-aa9d-9c7abfc524c3 service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:46:22.252405 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5985b1d-38a6-4a13-aa9d-9c7abfc524c3 service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:46:22.252775 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5985b1d-38a6-4a13-aa9d-9c7abfc524c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:46:22.262569 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5985b1d-38a6-4a13-aa9d-9c7abfc524c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:46:22.264283 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5985b1d-38a6-4a13-aa9d-9c7abfc524c3 service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:46:22.276152 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 615/1229] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:46:22 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 17:46:32.190672 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=9 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:46:32.270887 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=6 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:25.099057 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c7b0-1a07-4b4d-b659-3ceb7482b1e2 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:25.099584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c7b0-1a07-4b4d-b659-3ceb7482b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:25.099584 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c7b0-1a07-4b4d-b659-3ceb7482b1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:25.128170 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-0bb3c7b0-1a07-4b4d-b659-3ceb7482b1e2 None None] MFA Rules not processed for user `479c5ef172934abeafbb65a531083c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:25.129389 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-0bb3c7b0-1a07-4b4d-b659-3ceb7482b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:25.152099 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 615/1230] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:47:25 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:47:25.464303 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d588-da24-47e7-9b24-f4bb367a2fbe None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:25.464818 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d588-da24-47e7-9b24-f4bb367a2fbe None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:25.464919 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d588-da24-47e7-9b24-f4bb367a2fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:25.525490 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-08b2d588-da24-47e7-9b24-f4bb367a2fbe None None] MFA Rules not processed for user `f21c562918c04d18aa0b01a3bdd4d6af`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:25.526682 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-08b2d588-da24-47e7-9b24-f4bb367a2fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:25.560008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 616/1231] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 19 17:47:25 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:47:25.571518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3c7b0-1a07-4b4d-b659-3ceb7482b1e2 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:25.580935 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3c7b0-1a07-4b4d-b659-3ceb7482b1e2 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:25.584655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0843c-ebb0-4a42-b61c-3b8870d0eed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:25.585268 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0843c-ebb0-4a42-b61c-3b8870d0eed7 service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:25.585541 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0843c-ebb0-4a42-b61c-3b8870d0eed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:25.585808 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0843c-ebb0-4a42-b61c-3b8870d0eed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:25.592647 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0843c-ebb0-4a42-b61c-3b8870d0eed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:25.594124 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0843c-ebb0-4a42-b61c-3b8870d0eed7 service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:25.602096 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 616/1232] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:47:25 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:47:35.557266 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=28 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:35.598307 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=21 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:05.084484 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a051-6e72-4fee-817b-903cb2e579e8 None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:05.085008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a051-6e72-4fee-817b-903cb2e579e8 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:05.085098 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457a051-6e72-4fee-817b-903cb2e579e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:05.105372 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-4457a051-6e72-4fee-817b-903cb2e579e8 None None] MFA Rules not processed for user `479c5ef172934abeafbb65a531083c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:05.106580 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-4457a051-6e72-4fee-817b-903cb2e579e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:05.113418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 617/1233] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:48:05 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:48:15.099946 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=3 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:26.189975 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af480c-ffd7-4b5f-a451-3396b09411f9 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:26.190530 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af480c-ffd7-4b5f-a451-3396b09411f9 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:26.190530 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af480c-ffd7-4b5f-a451-3396b09411f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:26.209217 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-22af480c-ffd7-4b5f-a451-3396b09411f9 None None] MFA Rules not processed for user `479c5ef172934abeafbb65a531083c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:26.210410 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-22af480c-ffd7-4b5f-a451-3396b09411f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:26.218097 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 617/1234] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:48:26 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:48:28.407186 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457a051-6e72-4fee-817b-903cb2e579e8 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:28.437457 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457a051-6e72-4fee-817b-903cb2e579e8 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:28.442553 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaac61-30a5-4eba-a65d-4fc5d447f47f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82313d212e4f454697849ea186208785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:28.443489 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaac61-30a5-4eba-a65d-4fc5d447f47f service placement] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:28.443762 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaac61-30a5-4eba-a65d-4fc5d447f47f service placement] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:28.444026 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaac61-30a5-4eba-a65d-4fc5d447f47f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:28.452346 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaac61-30a5-4eba-a65d-4fc5d447f47f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:28.454014 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaac61-30a5-4eba-a65d-4fc5d447f47f service placement] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:28.463823 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 618/1235] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:48:28 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:48:36.204525 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=3 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:38.459693 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=13 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:49.090456 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c7127-e2f4-4b0f-a52b-2a1664c9f013 None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:49.090934 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c7127-e2f4-4b0f-a52b-2a1664c9f013 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:49.091027 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c7127-e2f4-4b0f-a52b-2a1664c9f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:49.119213 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-073c7127-e2f4-4b0f-a52b-2a1664c9f013 None None] MFA Rules not processed for user `479c5ef172934abeafbb65a531083c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:49.120408 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-073c7127-e2f4-4b0f-a52b-2a1664c9f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:49.127835 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 618/1236] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:49:49 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:49:59.114022 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=3 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:50:03.083353 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaac61-30a5-4eba-a65d-4fc5d447f47f service placement] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:50:03.092206 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaac61-30a5-4eba-a65d-4fc5d447f47f service placement] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:50:03.096023 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142d06f-babd-457b-96dc-c1f788143827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:50:03.096633 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d06f-babd-457b-96dc-c1f788143827 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:50:03.096938 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d06f-babd-457b-96dc-c1f788143827 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:50:03.097206 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d06f-babd-457b-96dc-c1f788143827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:50:03.105758 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142d06f-babd-457b-96dc-c1f788143827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:50:03.107200 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142d06f-babd-457b-96dc-c1f788143827 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:50:03.116418 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 619/1237] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:50:03 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:50:13.112453 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=6 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:50:39.832796 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c7127-e2f4-4b0f-a52b-2a1664c9f013 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:50:39.854129 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c7127-e2f4-4b0f-a52b-2a1664c9f013 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:50:39.859463 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4ec72-224a-4ca5-a6c0-d53271696043 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:50:39.860071 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4ec72-224a-4ca5-a6c0-d53271696043 service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:50:39.860351 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4ec72-224a-4ca5-a6c0-d53271696043 service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:50:39.860622 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4ec72-224a-4ca5-a6c0-d53271696043 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:50:39.869674 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4ec72-224a-4ca5-a6c0-d53271696043 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:50:39.871279 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4ec72-224a-4ca5-a6c0-d53271696043 service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:50:39.880858 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 619/1238] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:50:39 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:50:39.929267 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142d06f-babd-457b-96dc-c1f788143827 service neutron] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:50:39.938291 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142d06f-babd-457b-96dc-c1f788143827 service neutron] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:50:39.941972 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34307c6-ae5d-4da1-8462-a82f4d019cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:50:39.946316 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34307c6-ae5d-4da1-8462-a82f4d019cfc service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:50:39.946316 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34307c6-ae5d-4da1-8462-a82f4d019cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:50:39.946316 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34307c6-ae5d-4da1-8462-a82f4d019cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:50:39.953100 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34307c6-ae5d-4da1-8462-a82f4d019cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:50:39.954515 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34307c6-ae5d-4da1-8462-a82f4d019cfc service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:50:39.964565 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 620/1239] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:50:39 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:50:49.876506 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=10 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:50:49.960209 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=6 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:50:52.639706 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4ec72-224a-4ca5-a6c0-d53271696043 service nova] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:50:52.649192 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4ec72-224a-4ca5-a6c0-d53271696043 service nova] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:50:52.652659 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8964a-8a3e-435c-9d38-38553de55a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:50:52.656277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8964a-8a3e-435c-9d38-38553de55a67 service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:50:52.656277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8964a-8a3e-435c-9d38-38553de55a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:50:52.656277 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8964a-8a3e-435c-9d38-38553de55a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:50:52.663652 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8964a-8a3e-435c-9d38-38553de55a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:50:52.665107 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8964a-8a3e-435c-9d38-38553de55a67 service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:50:52.675542 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 620/1240] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:50:52 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:50:53.634748 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34307c6-ae5d-4da1-8462-a82f4d019cfc service neutron] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:50:53.645783 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34307c6-ae5d-4da1-8462-a82f4d019cfc service neutron] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:50:53.650901 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716e9b5-5e93-432d-8be7-7d23b694ad14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:50:53.651490 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e9b5-5e93-432d-8be7-7d23b694ad14 service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:50:53.651767 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e9b5-5e93-432d-8be7-7d23b694ad14 service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:50:53.652037 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e9b5-5e93-432d-8be7-7d23b694ad14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:50:53.660437 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716e9b5-5e93-432d-8be7-7d23b694ad14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:50:53.662232 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716e9b5-5e93-432d-8be7-7d23b694ad14 service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:50:53.672851 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 621/1241] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:50:53 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:51:02.671247 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=6 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:03.667855 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=6 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:04.628791 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07435-a436-4793-98c6-8ae6f170d00b None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:04.629375 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07435-a436-4793-98c6-8ae6f170d00b None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:04.629375 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07435-a436-4793-98c6-8ae6f170d00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:04.649290 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-11a07435-a436-4793-98c6-8ae6f170d00b None None] MFA Rules not processed for user `54209c27ba714b90859f06041f59671d`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:51:04.650482 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-11a07435-a436-4793-98c6-8ae6f170d00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:51:04.657471 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 621/1242] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 19 17:51:04 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:51:04.910675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716e9b5-5e93-432d-8be7-7d23b694ad14 service nova] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:04.920272 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716e9b5-5e93-432d-8be7-7d23b694ad14 service nova] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:04.928095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e36249-ba4a-4c4c-a47a-346e72f64cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:04.928095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e36249-ba4a-4c4c-a47a-346e72f64cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:04.928095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e36249-ba4a-4c4c-a47a-346e72f64cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:04.928095 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e36249-ba4a-4c4c-a47a-346e72f64cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:04.931675 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e36249-ba4a-4c4c-a47a-346e72f64cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:04.933127 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e36249-ba4a-4c4c-a47a-346e72f64cf2 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:04.941423 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 622/1243] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:51:04 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:51:05.380557 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07435-a436-4793-98c6-8ae6f170d00b None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:05.399982 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07435-a436-4793-98c6-8ae6f170d00b None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:05.408876 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3f6fc-9f7b-403d-aaae-bcae4c0d3ee2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82313d212e4f454697849ea186208785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:05.410410 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3f6fc-9f7b-403d-aaae-bcae4c0d3ee2 service placement] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:05.410410 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3f6fc-9f7b-403d-aaae-bcae4c0d3ee2 service placement] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:05.410410 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3f6fc-9f7b-403d-aaae-bcae4c0d3ee2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:05.423492 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3f6fc-9f7b-403d-aaae-bcae4c0d3ee2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:05.425403 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3f6fc-9f7b-403d-aaae-bcae4c0d3ee2 service placement] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:05.435851 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 622/1244] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:51:05 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:51:14.938117 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=6 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:15.431614 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=9 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:17.523235 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e36249-ba4a-4c4c-a47a-346e72f64cf2 service neutron] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:17.533276 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e36249-ba4a-4c4c-a47a-346e72f64cf2 service neutron] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:17.536847 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792175a6-f103-43cb-baa4-5ebe974bb12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:17.537442 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792175a6-f103-43cb-baa4-5ebe974bb12d service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:17.537718 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792175a6-f103-43cb-baa4-5ebe974bb12d service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:17.537991 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792175a6-f103-43cb-baa4-5ebe974bb12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:17.545716 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792175a6-f103-43cb-baa4-5ebe974bb12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:17.547789 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792175a6-f103-43cb-baa4-5ebe974bb12d service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:17.556016 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 623/1245] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:51:17 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:51:24.621433 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3f6fc-9f7b-403d-aaae-bcae4c0d3ee2 service placement] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:24.633538 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3f6fc-9f7b-403d-aaae-bcae4c0d3ee2 service placement] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:24.638521 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fedecc-f79a-4867-af44-1630f70dd87a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:24.641321 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fedecc-f79a-4867-af44-1630f70dd87a service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:24.641321 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fedecc-f79a-4867-af44-1630f70dd87a service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:24.641321 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fedecc-f79a-4867-af44-1630f70dd87a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:24.648113 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fedecc-f79a-4867-af44-1630f70dd87a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:24.649711 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fedecc-f79a-4867-af44-1630f70dd87a service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:24.659421 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 623/1246] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:51:24 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:51:27.552850 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=6 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:34.655363 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=6 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:36.308902 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792175a6-f103-43cb-baa4-5ebe974bb12d service neutron] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:36.318112 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792175a6-f103-43cb-baa4-5ebe974bb12d service neutron] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:36.322768 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe87a59-58fc-4900-b628-661376096575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:36.323388 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe87a59-58fc-4900-b628-661376096575 service neutron] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:36.323663 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe87a59-58fc-4900-b628-661376096575 service neutron] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:36.323929 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe87a59-58fc-4900-b628-661376096575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:36.333522 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe87a59-58fc-4900-b628-661376096575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:36.334965 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe87a59-58fc-4900-b628-661376096575 service neutron] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:36.344844 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 624/1247] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:51:36 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:51:38.122509 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fedecc-f79a-4867-af44-1630f70dd87a service nova] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:38.135566 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fedecc-f79a-4867-af44-1630f70dd87a service nova] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:38.141513 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb51fd-05fa-46b5-955a-927d8bd58b8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:38.142139 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb51fd-05fa-46b5-955a-927d8bd58b8a service nova] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:38.142391 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb51fd-05fa-46b5-955a-927d8bd58b8a service nova] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:38.142655 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb51fd-05fa-46b5-955a-927d8bd58b8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:38.151621 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb51fd-05fa-46b5-955a-927d8bd58b8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:38.153252 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb51fd-05fa-46b5-955a-927d8bd58b8a service nova] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:38.164421 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 624/1248] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:51:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 17:51:46.340305 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=6 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:48.159949 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=6 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:53:23.088163 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe87a59-58fc-4900-b628-661376096575 service neutron] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:53:23.098954 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe87a59-58fc-4900-b628-661376096575 service neutron] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:53:23.103813 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156dc4b-ced2-492c-936d-9a9a674aa195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb1c954936f64051b09afba8df544ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:53:23.104392 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156dc4b-ced2-492c-936d-9a9a674aa195 service nova] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:23.104667 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156dc4b-ced2-492c-936d-9a9a674aa195 service nova] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:23.104973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156dc4b-ced2-492c-936d-9a9a674aa195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:23.112893 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156dc4b-ced2-492c-936d-9a9a674aa195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:53:23.115998 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156dc4b-ced2-492c-936d-9a9a674aa195 service nova] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:53:23.125406 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 625/1249] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:53:23 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:53:33.120805 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=6 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:53:37.100698 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb51fd-05fa-46b5-955a-927d8bd58b8a service nova] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:53:37.109930 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb51fd-05fa-46b5-955a-927d8bd58b8a service nova] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:53:37.113729 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d47fa-f79b-438c-a0d5-7d30b7514080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:53:37.114326 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d47fa-f79b-438c-a0d5-7d30b7514080 service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:37.114588 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d47fa-f79b-438c-a0d5-7d30b7514080 service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:37.114856 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d47fa-f79b-438c-a0d5-7d30b7514080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:37.183313 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d47fa-f79b-438c-a0d5-7d30b7514080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:53:37.184868 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d47fa-f79b-438c-a0d5-7d30b7514080 service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:53:37.203499 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 625/1250] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:53:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:53:40.841916 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b39b5-446a-4e79-866b-7adadc72a5e7 None None] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:40.842364 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b39b5-446a-4e79-866b-7adadc72a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:40.842480 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b39b5-446a-4e79-866b-7adadc72a5e7 None None] PATH_INFO: `/` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:40.843973 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 626/1251] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 19 17:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:53:40.853882 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d13353-8bb7-42ff-b715-319866d0f9fc None None] REQUEST_METHOD: `POST` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:40.854314 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d13353-8bb7-42ff-b715-319866d0f9fc None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:40.854416 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d13353-8bb7-42ff-b715-319866d0f9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:40.905364 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.auth.core [None req-f2d13353-8bb7-42ff-b715-319866d0f9fc None None] MFA Rules not processed for user `82313d212e4f454697849ea186208785`. Rule list: `[]` (Enabled: `True`). {{(pid=88637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:53:40.906533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-f2d13353-8bb7-42ff-b715-319866d0f9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:53:40.916006 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 626/1252] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 19 17:53:40 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:53:40.927146 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b39b5-446a-4e79-866b-7adadc72a5e7 None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:53:40.928987 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-da0b39b5-446a-4e79-866b-7adadc72a5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:53:40.944817 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b39b5-446a-4e79-866b-7adadc72a5e7 None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:53:40.950040 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78c761-67ca-4dfd-b673-511ce183d8d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82313d212e4f454697849ea186208785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:53:40.950621 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78c761-67ca-4dfd-b673-511ce183d8d7 service placement] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:40.950899 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78c761-67ca-4dfd-b673-511ce183d8d7 service placement] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:40.951171 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78c761-67ca-4dfd-b673-511ce183d8d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:40.959135 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78c761-67ca-4dfd-b673-511ce183d8d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:53:40.960691 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78c761-67ca-4dfd-b673-511ce183d8d7 service placement] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:53:40.970077 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 627/1253] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:53:40 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:53:45.655373 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8800f6-834a-41c7-9b89-73feb94cc934 None None] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:45.655889 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8800f6-834a-41c7-9b89-73feb94cc934 None None] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:45.656047 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8800f6-834a-41c7-9b89-73feb94cc934 None None] PATH_INFO: `/` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:45.657533 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 627/1254] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 19 17:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:53:45.667593 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f58a7-9ffd-475a-a514-866653ed492a None None] REQUEST_METHOD: `POST` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:45.668060 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f58a7-9ffd-475a-a514-866653ed492a None None] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:45.668149 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f58a7-9ffd-475a-a514-866653ed492a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:45.688224 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.auth.core [None req-824f58a7-9ffd-475a-a514-866653ed492a None None] MFA Rules not processed for user `82313d212e4f454697849ea186208785`. Rule list: `[]` (Enabled: `True`). {{(pid=88636) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:53:45.689449 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-824f58a7-9ffd-475a-a514-866653ed492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:53:45.698366 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 628/1255] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 19 17:53:45 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:53:45.710739 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8800f6-834a-41c7-9b89-73feb94cc934 None None] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:53:45.725019 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8800f6-834a-41c7-9b89-73feb94cc934 None None] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:53:45.730000 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8e72e-d99c-4819-805d-01a99ede4d6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82313d212e4f454697849ea186208785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:53:45.730585 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8e72e-d99c-4819-805d-01a99ede4d6c service placement] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:45.736128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8e72e-d99c-4819-805d-01a99ede4d6c service placement] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:45.736128 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8e72e-d99c-4819-805d-01a99ede4d6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:45.739904 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8e72e-d99c-4819-805d-01a99ede4d6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:53:45.741515 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8e72e-d99c-4819-805d-01a99ede4d6c service placement] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:53:45.750832 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 628/1256] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:53:45 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:53:45.796822 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f58a7-9ffd-475a-a514-866653ed492a None None] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:53:45.808398 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f58a7-9ffd-475a-a514-866653ed492a None None] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:53:45.811571 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:53:45.812184 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:45.812455 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:45.812743 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] PATH_INFO: `/v3/users/479c5ef172934abeafbb65a531083c0f` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:45.813830 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] RBAC: Authorizing `identity:delete_user(user_id=479c5ef172934abeafbb65a531083c0f)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:53:45.815884 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:53:46.074683 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '479c5ef172934abeafbb65a531083c0f'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:46.081337 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '479c5ef172934abeafbb65a531083c0f'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:46.081992 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '479c5ef172934abeafbb65a531083c0f'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:46.147103 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '479c5ef172934abeafbb65a531083c0f'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:46.147740 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '479c5ef172934abeafbb65a531083c0f'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:46.167947 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 629/1257] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 19 17:53:45 2022] DELETE /identity/v3/users/479c5ef172934abeafbb65a531083c0f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:53:46.409933 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8e72e-d99c-4819-805d-01a99ede4d6c service placement] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:53:46.424296 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8e72e-d99c-4819-805d-01a99ede4d6c service placement] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:53:46.483328 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:53:46.483954 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:46.484256 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:46.484530 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] PATH_INFO: `/v3/projects/458cb47c34de48b092e860046d5d137a` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:46.485658 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=458cb47c34de48b092e860046d5d137a)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:53:46.487674 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:53:46.593854 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:53:46.603038 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458cb47c34de48b092e860046d5d137a', 'request_id': 'req-b6002c20-50af-422e-bae3-50c225444d1b'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:46.608682 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458cb47c34de48b092e860046d5d137a', 'request_id': 'req-b6002c20-50af-422e-bae3-50c225444d1b'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:46.670865 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458cb47c34de48b092e860046d5d137a', 'request_id': 'req-b6002c20-50af-422e-bae3-50c225444d1b'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:46.695846 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] The token cache is being invalidate because project 458cb47c34de48b092e860046d5d137a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 17:53:46.696150 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:46.696800 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:46.698270 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 629/1258] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 19 17:53:46 2022] DELETE /identity/v3/projects/458cb47c34de48b092e860046d5d137a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:53:46.702582 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:53:46.703982 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:53:46.717086 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e06556-36c2-44ba-8be7-44117bf8722d admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:53:46.773153 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:53:46.773822 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:46.774101 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:46.774376 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] PATH_INFO: `/v3/users/581e4df3cb474faeb12aee5a718690de` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:46.775646 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=581e4df3cb474faeb12aee5a718690de)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:53:46.777764 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:53:46.984741 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581e4df3cb474faeb12aee5a718690de'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:46.990586 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:53:46.992535 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581e4df3cb474faeb12aee5a718690de'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:46.993219 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581e4df3cb474faeb12aee5a718690de'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:47.059312 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581e4df3cb474faeb12aee5a718690de'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:47.059797 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581e4df3cb474faeb12aee5a718690de'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:47.077653 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 630/1259] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 19 17:53:46 2022] DELETE /identity/v3/users/581e4df3cb474faeb12aee5a718690de => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:53:47.331657 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:53:47.337184 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:53:47.347593 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6002c20-50af-422e-bae3-50c225444d1b admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:53:47.406871 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:53:47.407500 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:47.407772 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:47.408037 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] PATH_INFO: `/v3/projects/404ba60dcf494d73a4e46f4fc6948d37` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:47.409174 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=404ba60dcf494d73a4e46f4fc6948d37)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:53:47.411721 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:53:47.518290 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404ba60dcf494d73a4e46f4fc6948d37', 'request_id': 'req-610160b3-3f69-4f86-bf80-8e7b829039c9'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:47.524181 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404ba60dcf494d73a4e46f4fc6948d37', 'request_id': 'req-610160b3-3f69-4f86-bf80-8e7b829039c9'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:47.604046 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404ba60dcf494d73a4e46f4fc6948d37', 'request_id': 'req-610160b3-3f69-4f86-bf80-8e7b829039c9'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:47.615677 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] The token cache is being invalidate because project 404ba60dcf494d73a4e46f4fc6948d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 17:53:47.615969 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:47.616581 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:53:47.618145 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 630/1260] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 19 17:53:47 2022] DELETE /identity/v3/projects/404ba60dcf494d73a4e46f4fc6948d37 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:53:54.621374 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:53:54.622804 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:53:54.692903 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f6970-de27-42a5-8f6a-fadda01e32fa admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:53:54.750219 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1ec9c-e49b-42f4-a472-d4b21312940d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82313d212e4f454697849ea186208785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:53:54.750759 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1ec9c-e49b-42f4-a472-d4b21312940d service placement] REQUEST_METHOD: `GET` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:54.751039 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1ec9c-e49b-42f4-a472-d4b21312940d service placement] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:54.751312 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1ec9c-e49b-42f4-a472-d4b21312940d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:54.753051 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-70a1ec9c-e49b-42f4-a472-d4b21312940d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:53:54.764314 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1ec9c-e49b-42f4-a472-d4b21312940d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:53:54.765966 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1ec9c-e49b-42f4-a472-d4b21312940d service placement] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:53:54.775927 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 631/1261] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:53:54 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:53:56.794288 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:53:56.807626 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:53:56.841199 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:53:56.863681 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610160b3-3f69-4f86-bf80-8e7b829039c9 admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:53:56.868004 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321676a-5f52-4a48-8df7-884bd023ffc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f21c562918c04d18aa0b01a3bdd4d6af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b84e7b6ac1644538bb6ef2874a1f0cf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:53:56.868605 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321676a-5f52-4a48-8df7-884bd023ffc6 service neutron] REQUEST_METHOD: `GET` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:53:56.868918 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321676a-5f52-4a48-8df7-884bd023ffc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:53:56.869194 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321676a-5f52-4a48-8df7-884bd023ffc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:53:56.870910 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-b321676a-5f52-4a48-8df7-884bd023ffc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:53:56.932209 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321676a-5f52-4a48-8df7-884bd023ffc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:53:56.933661 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321676a-5f52-4a48-8df7-884bd023ffc6 service neutron] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:53:56.943096 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 631/1262] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 19 17:53:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:54:03.894039 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1ec9c-e49b-42f4-a472-d4b21312940d service placement] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:54:03.897251 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-70a1ec9c-e49b-42f4-a472-d4b21312940d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:54:03.909779 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1ec9c-e49b-42f4-a472-d4b21312940d service placement] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:54:03.914792 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:54:03.915406 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:54:03.915679 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:54:03.915947 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] PATH_INFO: `/v3/users/54209c27ba714b90859f06041f59671d` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:54:03.917085 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54209c27ba714b90859f06041f59671d)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:54:03.919126 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:54:04.107046 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54209c27ba714b90859f06041f59671d'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:04.113716 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54209c27ba714b90859f06041f59671d'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:04.114376 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54209c27ba714b90859f06041f59671d'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:04.116842 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:54:04.202965 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54209c27ba714b90859f06041f59671d'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:04.203597 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54209c27ba714b90859f06041f59671d'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:04.228252 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 632/1263] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 19 17:54:03 2022] DELETE /identity/v3/users/54209c27ba714b90859f06041f59671d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:54:04.491025 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321676a-5f52-4a48-8df7-884bd023ffc6 service neutron] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:54:04.502522 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321676a-5f52-4a48-8df7-884bd023ffc6 service neutron] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:54:04.570401 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:54:04.571032 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:54:04.571313 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:54:04.571583 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] PATH_INFO: `/v3/projects/8350c4b8d3034e90bf43db1ce58fe2c4` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:54:04.572798 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8350c4b8d3034e90bf43db1ce58fe2c4)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:54:04.575187 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:54:04.682191 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8350c4b8d3034e90bf43db1ce58fe2c4', 'request_id': 'req-c533446b-66d1-422f-8332-97b20c6802dc'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:04.688332 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8350c4b8d3034e90bf43db1ce58fe2c4', 'request_id': 'req-c533446b-66d1-422f-8332-97b20c6802dc'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:04.750652 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8350c4b8d3034e90bf43db1ce58fe2c4', 'request_id': 'req-c533446b-66d1-422f-8332-97b20c6802dc'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:04.762272 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] The token cache is being invalidate because project 8350c4b8d3034e90bf43db1ce58fe2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 17:54:04.762559 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:04.763184 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:04.764708 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 632/1264] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 19 17:54:04 2022] DELETE /identity/v3/projects/8350c4b8d3034e90bf43db1ce58fe2c4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:54:04.768789 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] Authenticating user token {{(pid=88636) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:54:04.770210 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.fernet_utils [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88636) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:54:04.782950 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434ee5-1a54-45f5-8ba2-bfa482183927 admin admin] Validating token access rules against request {{(pid=88636) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:54:04.838512 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d948bd-1948-44ea-acd9-1f7b1a33435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88636) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:54:04.839130 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d948bd-1948-44ea-acd9-1f7b1a33435d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:54:04.839413 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d948bd-1948-44ea-acd9-1f7b1a33435d admin admin] SCRIPT_NAME: `/identity` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:54:04.839686 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d948bd-1948-44ea-acd9-1f7b1a33435d admin admin] PATH_INFO: `/v3/users/c7f74cc4f980400a977feaf5ee2ff6e4` {{(pid=88636) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:54:04.840823 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d948bd-1948-44ea-acd9-1f7b1a33435d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f74cc4f980400a977feaf5ee2ff6e4)` {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:54:04.842781 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d948bd-1948-44ea-acd9-1f7b1a33435d admin admin] RBAC: Authorization granted {{(pid=88636) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:54:05.006311 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-83d948bd-1948-44ea-acd9-1f7b1a33435d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f74cc4f980400a977feaf5ee2ff6e4'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:05.013008 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-83d948bd-1948-44ea-acd9-1f7b1a33435d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f74cc4f980400a977feaf5ee2ff6e4'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:05.013667 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-83d948bd-1948-44ea-acd9-1f7b1a33435d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f74cc4f980400a977feaf5ee2ff6e4'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:05.055012 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-83d948bd-1948-44ea-acd9-1f7b1a33435d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f74cc4f980400a977feaf5ee2ff6e4'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:05.055631 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG keystone.notifications [None req-83d948bd-1948-44ea-acd9-1f7b1a33435d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f74cc4f980400a977feaf5ee2ff6e4'} {{(pid=88636) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:05.073450 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: [pid: 88636|app: 0|req: 633/1265] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 19 17:54:04 2022] DELETE /identity/v3/users/c7f74cc4f980400a977feaf5ee2ff6e4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:54:05.323500 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] Authenticating user token {{(pid=88637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:54:05.325236 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.fernet_utils [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:54:05.338518 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533446b-66d1-422f-8332-97b20c6802dc admin admin] Validating token access rules against request {{(pid=88637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:54:05.349600 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:54:05.397157 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4194ee18e96548d99ebb8f12d43b6b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72d7a88be3624749bd4e592197eaa598', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:54:05.397850 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:54:05.398127 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b admin admin] SCRIPT_NAME: `/identity` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:54:05.398393 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b admin admin] PATH_INFO: `/v3/projects/f6ad0faafeb24686a0a577735ad07eaa` {{(pid=88637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:54:05.399485 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ad0faafeb24686a0a577735ad07eaa)` {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:54:05.401406 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b admin admin] RBAC: Authorization granted {{(pid=88637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:54:05.500623 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ad0faafeb24686a0a577735ad07eaa', 'request_id': 'req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:05.506080 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ad0faafeb24686a0a577735ad07eaa', 'request_id': 'req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:05.556030 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ad0faafeb24686a0a577735ad07eaa', 'request_id': 'req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b'} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:05.567401 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b admin admin] The token cache is being invalidate because project f6ad0faafeb24686a0a577735ad07eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 17:54:05.567628 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:05.568257 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG keystone.notifications [None req-8662e5fb-e11e-4e9a-8163-1e7b184ac45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 17:54:05.569774 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: [pid: 88637|app: 0|req: 633/1266] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 19 17:54:05 2022] DELETE /identity/v3/projects/f6ad0faafeb24686a0a577735ad07eaa => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:54:15.069992 dv-osbrick-853777-1-ceph devstack@keystone.service[88636]: DEBUG dbcounter [-] [88636] Writing DB stats keystone:DELETE=13,keystone:SELECT=61,keystone:INSERT=1 {{(pid=88636) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:54:15.564409 dv-osbrick-853777-1-ceph devstack@keystone.service[88637]: DEBUG dbcounter [-] [88637] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}